Nov 16 17:55:26 user nova-compute[75342]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75342) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75342) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75342) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 17:55:26 user nova-compute[75342]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.023s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:55:26 user nova-compute[75342]: INFO nova.virt.driver [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 16 17:55:26 user nova-compute[75342]: INFO nova.compute.provider_config [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] Acquiring lock "singleton_lock" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] Acquired lock "singleton_lock" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] Releasing lock "singleton_lock" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] Full set of CONF: {{(pid=75342) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ******************************************************************************** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] Configuration options gathered from: {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ================================================================================ {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] allow_resize_to_same_host      = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] arq_binding_timeout            = 300 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] backdoor_port                  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] backdoor_socket                = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] block_device_allocate_retries  = 300 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] block_device_allocate_retries_interval = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cert                           = self.pem {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute_monitors               = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] config_dir                     = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] config_drive_format            = iso9660 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] config_source                  = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] console_host                   = user {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] control_exchange               = nova {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cpu_allocation_ratio           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] daemon                         = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] debug                          = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] default_access_ip_network_name = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] default_availability_zone      = nova {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] default_ephemeral_format       = ext4 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] default_green_pool_size        = 1000 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] default_schedule_zone          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] disk_allocation_ratio          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] enable_new_services            = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] enabled_ssl_apis               = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] flat_injected                  = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] force_config_drive             = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] force_raw_images               = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] graceful_shutdown_timeout      = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] heal_instance_info_cache_interval = 60 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] host                           = user {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] instance_build_timeout         = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] instance_delete_interval       = 300 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] instance_name_template         = instance-%08x {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] instance_usage_audit           = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] instance_usage_audit_period    = month {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] internal_service_availability_zone = internal {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] key                            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] live_migration_retry_count     = 30 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] log_config_append              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] log_dir                        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] log_file                       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] log_options                    = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] log_rotate_interval            = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] log_rotate_interval_type       = days {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] log_rotation_type              = none {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] long_rpc_timeout               = 1800 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] max_concurrent_builds          = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] max_concurrent_live_migrations = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] max_concurrent_snapshots       = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] max_local_block_devices        = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] max_logfile_count              = 30 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] max_logfile_size_mb            = 200 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] maximum_instance_delete_attempts = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] metadata_listen                = 0.0.0.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] metadata_listen_port           = 8775 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] metadata_workers               = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] migrate_max_retries            = -1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] mkisofs_cmd                    = genisoimage {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] my_ip                          = 10.0.0.210 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] network_allocate_retries       = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] osapi_compute_listen_port      = 8774 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] osapi_compute_unique_server_name_scope =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] osapi_compute_workers          = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] password_length                = 12 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] periodic_enable                = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] periodic_fuzzy_delay           = 60 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] pointer_model                  = ps2mouse {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] preallocate_images             = none {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] publish_errors                 = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] pybasedir                      = /opt/stack/nova {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ram_allocation_ratio           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] rate_limit_burst               = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] rate_limit_except_level        = CRITICAL {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] rate_limit_interval            = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] reboot_timeout                 = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] reclaim_instance_interval      = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] record                         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] reimage_timeout_per_gb         = 60 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] report_interval                = 120 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] rescue_timeout                 = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] reserved_host_cpus             = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] reserved_host_disk_mb          = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] reserved_host_memory_mb        = 512 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] reserved_huge_pages            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] resize_confirm_window          = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] resize_fs_using_block_device   = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] resume_guests_state_on_host_boot = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] rpc_response_timeout           = 60 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] run_external_periodic_tasks    = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] running_deleted_instance_action = reap {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] running_deleted_instance_timeout = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] scheduler_instance_sync_interval = 120 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] service_down_time              = 720 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] servicegroup_driver            = db {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] shelved_offload_time           = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] shelved_poll_interval          = 3600 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] shutdown_timeout               = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] source_is_ipv6                 = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ssl_only                       = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] state_path                     = /opt/stack/data/nova {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] sync_power_state_interval      = 600 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] sync_power_state_pool_size     = 1000 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] syslog_log_facility            = LOG_USER {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] tempdir                        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] timeout_nbd                    = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] transport_url                  = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] update_resources_interval      = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] use_cow_images                 = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] use_eventlog                   = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] use_journal                    = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] use_json                       = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] use_rootwrap_daemon            = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] use_stderr                     = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] use_syslog                     = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vcpu_pin_set                   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plugging_is_fatal          = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plugging_timeout           = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] virt_mkfs                      = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] volume_usage_poll_interval     = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] watch_log_file                 = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] web                            = /usr/share/spice-html5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_concurrency.disable_process_locking = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.auth_strategy              = keystone {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.compute_link_prefix        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.dhcp_domain                = novalocal {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.enable_instance_password   = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.glance_link_prefix         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.instance_list_per_project_cells = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.list_records_by_skipping_down_cells = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.local_metadata_per_cell    = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.max_limit                  = 1000 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.metadata_cache_expiration  = 15 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.neutron_default_tenant_id  = default {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.use_forwarded_for          = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.use_neutron_default_nets   = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.vendordata_dynamic_targets = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.vendordata_jsonfile_path   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.backend_argument         = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.config_prefix            = cache.oslo {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.dead_timeout             = 60.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.debug_cache_backend      = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.enable_retry_client      = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.enable_socket_keepalive  = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.enabled                  = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.expiration_time          = 600 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.hashclient_retry_attempts = 2 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.memcache_dead_retry      = 300 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.memcache_password        =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.memcache_sasl_enabled    = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.memcache_username        =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.proxies                  = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.retry_attempts           = 2 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.retry_delay              = 0.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.socket_keepalive_count   = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.socket_keepalive_idle    = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.socket_keepalive_interval = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.tls_allowed_ciphers      = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.tls_cafile               = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.tls_certfile             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.tls_enabled              = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cache.tls_keyfile              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.auth_section            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.auth_type               = password {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.cafile                  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.certfile                = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.collect_timing          = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.cross_az_attach         = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.debug                   = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.endpoint_template       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.http_retries            = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.insecure                = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.keyfile                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.os_region_name          = RegionOne {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.split_loggers           = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cinder.timeout                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.cpu_dedicated_set      = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.cpu_shared_set         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.image_type_exclude_list = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.resource_provider_association_refresh = 300 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.shutdown_retry_interval = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] conductor.workers              = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] console.allowed_origins        = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] console.ssl_ciphers            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] console.ssl_minimum_version    = default {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] consoleauth.token_ttl          = 600 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.cafile                  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.certfile                = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.collect_timing          = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.connect_retries         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.connect_retry_delay     = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.endpoint_override       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.insecure                = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.keyfile                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.max_version             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.min_version             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.region_name             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.service_name            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.service_type            = accelerator {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.split_loggers           = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.status_code_retries     = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.status_code_retry_delay = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.timeout                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] cyborg.version                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.backend               = sqlalchemy {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.connection            = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.connection_debug      = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.connection_parameters =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.connection_recycle_time = 3600 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.connection_trace      = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.db_inc_retry_interval = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.db_max_retries        = 20 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.db_max_retry_interval = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.db_retry_interval     = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.max_overflow          = 50 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.max_pool_size         = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.max_retries           = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.mysql_wsrep_sync_wait = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.pool_timeout          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.retry_interval        = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.slave_connection      = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] database.sqlite_synchronous    = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.backend           = sqlalchemy {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.connection        = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.connection_debug  = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.connection_parameters =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.connection_recycle_time = 3600 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.connection_trace  = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.db_inc_retry_interval = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.db_max_retries    = 20 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.db_max_retry_interval = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.db_retry_interval = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.max_overflow      = 50 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.max_pool_size     = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.max_retries       = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.pool_timeout      = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.retry_interval    = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.slave_connection  = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] api_database.sqlite_synchronous = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] devices.enabled_mdev_types     = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ephemeral_storage_encryption.enabled = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.api_servers             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.cafile                  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.certfile                = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.collect_timing          = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.connect_retries         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.connect_retry_delay     = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.debug                   = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.default_trusted_certificate_ids = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.enable_certificate_validation = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.enable_rbd_download     = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.endpoint_override       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.insecure                = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.keyfile                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.max_version             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.min_version             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.num_retries             = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.rbd_ceph_conf           =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.rbd_connect_timeout     = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.rbd_pool                =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.rbd_user                =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.region_name             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.service_name            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.service_type            = image {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.split_loggers           = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.status_code_retries     = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.status_code_retry_delay = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.timeout                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.verify_glance_signatures = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] glance.version                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] guestfs.debug                  = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.config_drive_cdrom      = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.config_drive_inject_password = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.enable_remotefx         = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.instances_path_share    =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.limit_cpu_features      = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.use_multipath_io        = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.vswitch_name            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] mks.enabled                    = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] image_cache.manager_interval   = 2400 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] image_cache.precache_concurrency = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] image_cache.remove_unused_base_images = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] image_cache.subdirectory_name  = _base {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.api_max_retries         = 60 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.api_retry_interval      = 2 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.auth_section            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.auth_type               = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.cafile                  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.certfile                = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.collect_timing          = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.conductor_group         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.connect_retries         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.connect_retry_delay     = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.endpoint_override       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.insecure                = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.keyfile                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.max_version             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.min_version             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.peer_list               = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.region_name             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.serial_console_state_timeout = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.service_name            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.service_type            = baremetal {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.split_loggers           = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.status_code_retries     = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.status_code_retry_delay = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.timeout                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ironic.version                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] key_manager.fixed_key          = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.barbican_api_version  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.barbican_endpoint     = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.barbican_endpoint_type = public {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.barbican_region_name  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.cafile                = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.certfile              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.collect_timing        = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.insecure              = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.keyfile               = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.number_of_retries     = 60 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.retry_delay           = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.send_service_user_token = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.split_loggers         = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.timeout               = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.verify_ssl            = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican.verify_ssl_path       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican_service_user.auth_section = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican_service_user.auth_type = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican_service_user.cafile   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican_service_user.certfile = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican_service_user.collect_timing = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican_service_user.insecure = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican_service_user.keyfile  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican_service_user.split_loggers = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] barbican_service_user.timeout  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.approle_role_id          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.approle_secret_id        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.cafile                   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.certfile                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.collect_timing           = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.insecure                 = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.keyfile                  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.kv_mountpoint            = secret {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.kv_path                  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.kv_version               = 2 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.namespace                = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.root_token_id            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.split_loggers            = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.ssl_ca_crt_file          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.timeout                  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.use_ssl                  = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.auth_section          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.auth_type             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.cafile                = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.certfile              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.collect_timing        = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.connect_retries       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.connect_retry_delay   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.endpoint_override     = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.insecure              = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.keyfile               = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.max_version           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.min_version           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.region_name           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.service_name          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.service_type          = identity {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.split_loggers         = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.status_code_retries   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.status_code_retry_delay = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.timeout               = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] keystone.version               = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.connection_uri         =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.cpu_mode               = custom {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: WARNING oslo_config.cfg [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.cpu_power_governor_high = performance {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.cpu_power_management   = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.device_detach_attempts = 8 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.device_detach_timeout  = 20 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.disk_cachemodes        = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.disk_prefix            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.enabled_perf_events    = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.file_backed_memory     = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.gid_maps               = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.hw_disk_discard        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.hw_machine_type        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.images_rbd_pool        = rbd {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.images_type            = default {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.images_volume_group    = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.inject_key             = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.inject_partition       = -2 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.inject_password        = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.iscsi_iface            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.iser_use_multipath     = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_downtime = 500 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_inbound_addr = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_scheme  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_timeout_action = abort {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_tunnelled = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: WARNING oslo_config.cfg [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 16 17:55:26 user nova-compute[75342]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 16 17:55:26 user nova-compute[75342]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 16 17:55:26 user nova-compute[75342]: and ``live_migration_inbound_addr`` respectively.
Nov 16 17:55:26 user nova-compute[75342]: ).  Its value may be silently ignored in the future.
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.live_migration_with_native_tls = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.max_queues             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.nfs_mount_options      = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.num_pcie_ports         = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.pmem_namespaces        = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.quobyte_client_cfg     = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.rbd_secret_uuid        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.rbd_user               = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.rescue_image_id        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.rescue_kernel_id       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.rx_queue_size          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.smbfs_mount_options    =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.snapshot_compression   = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.snapshot_image_format  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.sparse_logical_volumes = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.swtpm_enabled          = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.swtpm_group            = tss {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.swtpm_user             = tss {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.sysinfo_serial         = unique {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.tb_cache_size          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.tx_queue_size          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.uid_maps               = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.use_virtio_for_bridges = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.virt_type              = kvm {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.volume_clear           = zero {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.volume_clear_size      = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.volume_use_multipath   = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.vzstorage_cache_path   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.auth_section           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.auth_type              = password {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.cafile                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.certfile               = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.collect_timing         = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.connect_retries        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.connect_retry_delay    = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.default_floating_pool  = public {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.endpoint_override      = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.extension_sync_interval = 600 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.http_retries           = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.insecure               = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.keyfile                = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.max_version            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.min_version            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.ovs_bridge             = br-int {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.physnets               = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.region_name            = RegionOne {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.service_metadata_proxy = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.service_name           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.service_type           = network {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.split_loggers          = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.status_code_retries    = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.status_code_retry_delay = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.timeout                = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] neutron.version                = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] notifications.bdms_in_notifications = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] notifications.default_level    = INFO {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] notifications.notification_format = unversioned {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] notifications.notify_on_state_change = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] pci.alias                      = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] pci.device_spec                = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] pci.report_in_placement        = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.auth_section         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.auth_type            = password {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.cafile               = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.certfile             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.collect_timing       = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.connect_retries      = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.connect_retry_delay  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.default_domain_id    = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.default_domain_name  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.domain_id            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.domain_name          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.endpoint_override    = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.insecure             = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.keyfile              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.max_version          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.min_version          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.password             = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.project_domain_id    = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.project_domain_name  = Default {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.project_id           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.project_name         = service {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.region_name          = RegionOne {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.service_name         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.service_type         = placement {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.split_loggers        = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.status_code_retries  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.status_code_retry_delay = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.system_scope         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.timeout              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.trust_id             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.user_domain_id       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.user_domain_name     = Default {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.user_id              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.username             = placement {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] placement.version              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.cores                    = 20 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.count_usage_from_placement = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.injected_file_content_bytes = 10240 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.injected_file_path_length = 255 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.injected_files           = 5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.instances                = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.key_pairs                = 100 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.metadata_items           = 128 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.ram                      = 51200 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.recheck_quota            = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.server_group_members     = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] quota.server_groups            = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] rdp.enabled                    = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] scheduler.image_metadata_prefilter = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] scheduler.max_attempts         = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] scheduler.max_placement_results = 1000 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] scheduler.workers              = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.host_subset_size = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.isolated_hosts = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.isolated_images = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.pci_in_placement = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.track_instance_changes = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] metrics.required               = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] metrics.weight_multiplier      = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] metrics.weight_setting         = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] serial_console.enabled         = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] serial_console.port_range      = 10000:20000 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] serial_console.serialproxy_port = 6083 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] service_user.auth_section      = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] service_user.auth_type         = password {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] service_user.cafile            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] service_user.certfile          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] service_user.collect_timing    = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] service_user.insecure          = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] service_user.keyfile           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] service_user.send_service_user_token = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] service_user.split_loggers     = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] service_user.timeout           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.agent_enabled            = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.enabled                  = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.html5proxy_port          = 6082 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.image_compression        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.jpeg_compression         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.playback_compression     = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.server_listen            = 127.0.0.1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.streaming_mode           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] spice.zlib_compression         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] upgrade_levels.baseapi         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] upgrade_levels.cert            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] upgrade_levels.compute         = auto {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] upgrade_levels.conductor       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] upgrade_levels.scheduler       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vendordata_dynamic_auth.cafile = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vendordata_dynamic_auth.certfile = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vendordata_dynamic_auth.insecure = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vendordata_dynamic_auth.timeout = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.api_retry_count         = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.ca_file                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.cache_prefix            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.cluster_name            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.connection_pool_size    = 10 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.console_delay_seconds   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.datastore_regex         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.host_ip                 = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.host_password           = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.host_port               = 443 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.host_username           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.insecure                = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.integration_bridge      = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.maximum_objects         = 100 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.pbm_default_policy      = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.pbm_enabled             = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.pbm_wsdl_location       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.serial_port_proxy_uri   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.serial_port_service_uri = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.task_poll_interval      = 0.5 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.use_linked_clone        = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.vnc_keymap              = en-us {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.vnc_port                = 5900 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vmware.vnc_port_total          = 10000 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vnc.auth_schemes               = ['none'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vnc.enabled                    = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vnc.novncproxy_port            = 6080 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vnc.vencrypt_ca_certs          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vnc.vencrypt_client_cert       = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vnc.vencrypt_client_key        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.disable_rootwrap   = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.enable_numa_live_migration = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.libvirt_disable_apic = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] wsgi.client_socket_timeout     = 900 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] wsgi.default_pool_size         = 1000 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] wsgi.keep_alive                = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] wsgi.max_header_line           = 16384 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] wsgi.ssl_ca_file               = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] wsgi.ssl_cert_file             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] wsgi.ssl_key_file              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] wsgi.tcp_keepidle              = 600 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] zvm.ca_file                    = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] zvm.cloud_connector_url        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] zvm.reachable_timeout          = 300 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_policy.enforce_new_defaults = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_policy.enforce_scope      = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_policy.policy_default_rule = default {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler.connection_string     = messaging:// {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler.enabled               = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler.es_doc_type           = notification {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler.es_scroll_size        = 10000 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler.es_scroll_time        = 2m {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler.filter_error_trace    = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler.hmac_keys             = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler.sentinel_service_name = mymaster {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler.socket_timeout        = 0.1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler.trace_requests        = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler.trace_sqlalchemy      = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler_jaeger.process_tags   = {} {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler_jaeger.service_name_prefix = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] profiler_otlp.service_name_prefix = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] remote_debug.host              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] remote_debug.port              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_notifications.retry = -1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.auth_section        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.auth_type           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.cafile              = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.certfile            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.collect_timing      = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.connect_retries     = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.connect_retry_delay = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.endpoint_id         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.endpoint_override   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.insecure            = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.keyfile             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.max_version         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.min_version         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.region_name         = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.service_name        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.service_type        = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.split_loggers       = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.status_code_retries = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.status_code_retry_delay = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.timeout             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.valid_interfaces    = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_limit.version             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_reports.file_event_handler = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] oslo_reports.log_dir           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_ovs_privileged.group  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] vif_plug_ovs_privileged.user   = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_ovs.isolate_vif         = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] os_brick.lock_path             = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] privsep_osbrick.capabilities   = [21] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] privsep_osbrick.group          = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] privsep_osbrick.helper_command = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] privsep_osbrick.user           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] nova_sys_admin.group           = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] nova_sys_admin.helper_command  = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] nova_sys_admin.user            = None {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG oslo_service.service [None req-af98f261-2ca9-4e29-9225-5d9eaea2fc56 None None] ******************************************************************************** {{(pid=75342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 16 17:55:26 user nova-compute[75342]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 16 17:55:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Connecting to libvirt: qemu:///system {{(pid=75342) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd6d14fa470> {{(pid=75342) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 16 17:55:26 user nova-compute[75342]: libvirt:  error : internal error: could not initialize domain event timer
Nov 16 17:55:26 user nova-compute[75342]: WARNING nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 16 17:55:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd6d14fa470> {{(pid=75342) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Starting native event thread {{(pid=75342) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Starting green dispatch thread {{(pid=75342) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 16 17:55:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Starting connection event dispatch thread {{(pid=75342) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 16 17:55:26 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Connection event '1' reason 'None'
Nov 16 17:55:26 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 17:55:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.mount [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Initialising _HostMountState generation 0 {{(pid=75342) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 16 17:55:34 user nova-compute[75342]: INFO nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Libvirt host capabilities <capabilities>
Nov 16 17:55:34 user nova-compute[75342]:   <host>
Nov 16 17:55:34 user nova-compute[75342]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 16 17:55:34 user nova-compute[75342]:     <cpu>
Nov 16 17:55:34 user nova-compute[75342]:       <arch>x86_64</arch>
Nov 16 17:55:34 user nova-compute[75342]:       <model>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <vendor>Intel</vendor>
Nov 16 17:55:34 user nova-compute[75342]:       <microcode version='1070'/>
Nov 16 17:55:34 user nova-compute[75342]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 16 17:55:34 user nova-compute[75342]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='ss'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='vmx'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='pcid'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='osxsave'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='hypervisor'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='arat'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='tsc_adjust'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='md-clear'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='arch-capabilities'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='invtsc'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='rsba'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature name='skip-l1dfl-vmentry'/>
Nov 16 17:55:34 user nova-compute[75342]:       <pages unit='KiB' size='4'/>
Nov 16 17:55:34 user nova-compute[75342]:       <pages unit='KiB' size='2048'/>
Nov 16 17:55:34 user nova-compute[75342]:     </cpu>
Nov 16 17:55:34 user nova-compute[75342]:     <power_management>
Nov 16 17:55:34 user nova-compute[75342]:       <suspend_mem/>
Nov 16 17:55:34 user nova-compute[75342]:       <suspend_disk/>
Nov 16 17:55:34 user nova-compute[75342]:       <suspend_hybrid/>
Nov 16 17:55:34 user nova-compute[75342]:     </power_management>
Nov 16 17:55:34 user nova-compute[75342]:     <iommu support='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     <migration_features>
Nov 16 17:55:34 user nova-compute[75342]:       <live/>
Nov 16 17:55:34 user nova-compute[75342]:       <uri_transports>
Nov 16 17:55:34 user nova-compute[75342]:         <uri_transport>tcp</uri_transport>
Nov 16 17:55:34 user nova-compute[75342]:         <uri_transport>rdma</uri_transport>
Nov 16 17:55:34 user nova-compute[75342]:       </uri_transports>
Nov 16 17:55:34 user nova-compute[75342]:     </migration_features>
Nov 16 17:55:34 user nova-compute[75342]:     <topology>
Nov 16 17:55:34 user nova-compute[75342]:       <cells num='2'>
Nov 16 17:55:34 user nova-compute[75342]:         <cell id='0'>
Nov 16 17:55:34 user nova-compute[75342]:           <memory unit='KiB'>8140616</memory>
Nov 16 17:55:34 user nova-compute[75342]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 16 17:55:34 user nova-compute[75342]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 17:55:34 user nova-compute[75342]:           <distances>
Nov 16 17:55:34 user nova-compute[75342]:             <sibling id='0' value='10'/>
Nov 16 17:55:34 user nova-compute[75342]:             <sibling id='1' value='20'/>
Nov 16 17:55:34 user nova-compute[75342]:           </distances>
Nov 16 17:55:34 user nova-compute[75342]:           <cpus num='6'>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 16 17:55:34 user nova-compute[75342]:           </cpus>
Nov 16 17:55:34 user nova-compute[75342]:         </cell>
Nov 16 17:55:34 user nova-compute[75342]:         <cell id='1'>
Nov 16 17:55:34 user nova-compute[75342]:           <memory unit='KiB'>8255068</memory>
Nov 16 17:55:34 user nova-compute[75342]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 16 17:55:34 user nova-compute[75342]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 17:55:34 user nova-compute[75342]:           <distances>
Nov 16 17:55:34 user nova-compute[75342]:             <sibling id='0' value='20'/>
Nov 16 17:55:34 user nova-compute[75342]:             <sibling id='1' value='10'/>
Nov 16 17:55:34 user nova-compute[75342]:           </distances>
Nov 16 17:55:34 user nova-compute[75342]:           <cpus num='6'>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 16 17:55:34 user nova-compute[75342]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 16 17:55:34 user nova-compute[75342]:           </cpus>
Nov 16 17:55:34 user nova-compute[75342]:         </cell>
Nov 16 17:55:34 user nova-compute[75342]:       </cells>
Nov 16 17:55:34 user nova-compute[75342]:     </topology>
Nov 16 17:55:34 user nova-compute[75342]:     <cache>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 16 17:55:34 user nova-compute[75342]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 16 17:55:34 user nova-compute[75342]:     </cache>
Nov 16 17:55:34 user nova-compute[75342]:     <secmodel>
Nov 16 17:55:34 user nova-compute[75342]:       <model>apparmor</model>
Nov 16 17:55:34 user nova-compute[75342]:       <doi>0</doi>
Nov 16 17:55:34 user nova-compute[75342]:     </secmodel>
Nov 16 17:55:34 user nova-compute[75342]:     <secmodel>
Nov 16 17:55:34 user nova-compute[75342]:       <model>dac</model>
Nov 16 17:55:34 user nova-compute[75342]:       <doi>0</doi>
Nov 16 17:55:34 user nova-compute[75342]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 16 17:55:34 user nova-compute[75342]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 16 17:55:34 user nova-compute[75342]:     </secmodel>
Nov 16 17:55:34 user nova-compute[75342]:   </host>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='alpha'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>64</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>clipper</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='armv6l'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>spitz</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>nuri</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>kzm</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sx1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>z2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>tosa</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>n810</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>n800</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>terrier</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>midway</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>microbit</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>verdex</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>highbank</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>akita</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>connex</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>collie</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='armv7l'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>spitz</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>nuri</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>kzm</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sx1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>z2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>tosa</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>n810</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>n800</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>terrier</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>midway</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>microbit</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>verdex</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>highbank</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>akita</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>connex</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>collie</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='aarch64'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>64</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>spitz</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>nuri</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>kzm</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sx1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>z2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>tosa</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>n810</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>n800</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>terrier</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>midway</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>microbit</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>verdex</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>raspi3b</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>highbank</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>akita</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>connex</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>collie</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <acpi default='on' toggle='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='cris'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='i686'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>isapc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>microvm</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='kvm'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <pae/>
Nov 16 17:55:34 user nova-compute[75342]:       <nonpae/>
Nov 16 17:55:34 user nova-compute[75342]:       <acpi default='on' toggle='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:       <apic default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='m68k'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>an5206</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>q800</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>next-cube</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='microblaze'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='microblazeel'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='mips'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='16'>malta</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='mipsel'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='16'>malta</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='mips64'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>64</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='16'>malta</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>pica61</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>magnum</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='mips64el'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>64</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='16'>malta</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>pica61</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>magnum</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='16'>boston</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='ppc'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mac99</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>40p</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>taihu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='ppc64'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>64</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>taihu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>40p</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mac99</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='ppc64le'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>64</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>taihu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>40p</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>mac99</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='riscv32'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='8'>spike</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>opentitan</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='8'>virt</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='riscv64'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>64</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='8'>spike</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>shakti_c</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='8'>virt</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='s390x'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>64</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='sh4'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>shix</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>r2d</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='sh4eb'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>64</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>shix</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>r2d</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='sparc'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>SS-5</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>SS-20</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>LX</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>SS-4</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>SS-10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>Voyager</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='sparc64'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>64</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sun4u</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>niagara</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>sun4v</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='x86_64'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>64</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='1'>isapc</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>microvm</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='kvm'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <acpi default='on' toggle='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:       <apic default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='xtensa'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>sim</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>kc705</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>ml605</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>virt</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>lx200</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>lx60</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]:   <guest>
Nov 16 17:55:34 user nova-compute[75342]:     <os_type>hvm</os_type>
Nov 16 17:55:34 user nova-compute[75342]:     <arch name='xtensaeb'>
Nov 16 17:55:34 user nova-compute[75342]:       <wordsize>32</wordsize>
Nov 16 17:55:34 user nova-compute[75342]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='4'>sim</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>kc705</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>ml605</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>virt</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>lx200</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>lx60</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 17:55:34 user nova-compute[75342]:       <domain type='qemu'/>
Nov 16 17:55:34 user nova-compute[75342]:     </arch>
Nov 16 17:55:34 user nova-compute[75342]:     <features>
Nov 16 17:55:34 user nova-compute[75342]:       <cpuselection/>
Nov 16 17:55:34 user nova-compute[75342]:       <deviceboot/>
Nov 16 17:55:34 user nova-compute[75342]:       <disksnapshot default='on' toggle='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     </features>
Nov 16 17:55:34 user nova-compute[75342]:   </guest>
Nov 16 17:55:34 user nova-compute[75342]: </capabilities>
Nov 16 17:55:34 user nova-compute[75342]: 
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 16 17:55:34 user nova-compute[75342]: <domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 17:55:34 user nova-compute[75342]:   <domain>kvm</domain>
Nov 16 17:55:34 user nova-compute[75342]:   <machine>pc-q35-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:   <arch>i686</arch>
Nov 16 17:55:34 user nova-compute[75342]:   <vcpu max='288'/>
Nov 16 17:55:34 user nova-compute[75342]:   <iothreads supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:   <os supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='firmware'/>
Nov 16 17:55:34 user nova-compute[75342]:     <loader supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>rom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pflash</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='readonly'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>yes</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='secure'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </loader>
Nov 16 17:55:34 user nova-compute[75342]:   </os>
Nov 16 17:55:34 user nova-compute[75342]:   <cpu>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-passthrough' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='hostPassthroughMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='maximum' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='maximumMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-model' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <vendor>Intel</vendor>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ss'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='vmx'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pcid'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='hypervisor'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arat'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='umip'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='md-clear'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibpb'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibrs'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='erms'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='lm'/>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='custom' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>qemu64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>qemu32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>phenom</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>n270</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>kvm64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>coreduo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>core2duo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>athlon</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Westmere</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Snowridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Penryn</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G5</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G4</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G1</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Nehalem</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Rome</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Milan</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Dhyana</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cooperlake</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Conroe</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>486</model>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:   </cpu>
Nov 16 17:55:34 user nova-compute[75342]:   <memoryBacking supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='sourceType'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>file</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>anonymous</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>memfd</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:   </memoryBacking>
Nov 16 17:55:34 user nova-compute[75342]:   <devices>
Nov 16 17:55:34 user nova-compute[75342]:     <disk supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='diskDevice'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>disk</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cdrom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>floppy</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>lun</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='bus'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>fdc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sata</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </disk>
Nov 16 17:55:34 user nova-compute[75342]:     <graphics supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sdl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vnc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>spice</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egl-headless</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </graphics>
Nov 16 17:55:34 user nova-compute[75342]:     <video supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='modelType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cirrus</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vmvga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>qxl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>none</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>bochs</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ramfb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </video>
Nov 16 17:55:34 user nova-compute[75342]:     <hostdev supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='mode'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>subsystem</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='startupPolicy'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>default</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>mandatory</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>requisite</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>optional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='subsysType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pci</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='capsType'/>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='pciBackend'/>
Nov 16 17:55:34 user nova-compute[75342]:     </hostdev>
Nov 16 17:55:34 user nova-compute[75342]:     <rng supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>random</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egd</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>builtin</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </rng>
Nov 16 17:55:34 user nova-compute[75342]:     <filesystem supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='driverType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>path</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>handle</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtiofs</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </filesystem>
Nov 16 17:55:34 user nova-compute[75342]:     <tpm supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-tis</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-crb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>passthrough</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>emulator</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </tpm>
Nov 16 17:55:34 user nova-compute[75342]:   </devices>
Nov 16 17:55:34 user nova-compute[75342]:   <features>
Nov 16 17:55:34 user nova-compute[75342]:     <gic supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     <vmcoreinfo supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <genid supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backingStoreInput supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backup supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <sev supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:   </features>
Nov 16 17:55:34 user nova-compute[75342]: </domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:  {{(pid=75342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 16 17:55:34 user nova-compute[75342]: <domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 17:55:34 user nova-compute[75342]:   <domain>kvm</domain>
Nov 16 17:55:34 user nova-compute[75342]:   <machine>pc-i440fx-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:   <arch>i686</arch>
Nov 16 17:55:34 user nova-compute[75342]:   <vcpu max='255'/>
Nov 16 17:55:34 user nova-compute[75342]:   <iothreads supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:   <os supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='firmware'/>
Nov 16 17:55:34 user nova-compute[75342]:     <loader supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>rom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pflash</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='readonly'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>yes</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='secure'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </loader>
Nov 16 17:55:34 user nova-compute[75342]:   </os>
Nov 16 17:55:34 user nova-compute[75342]:   <cpu>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-passthrough' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='hostPassthroughMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='maximum' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='maximumMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-model' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <vendor>Intel</vendor>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ss'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='vmx'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pcid'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='hypervisor'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arat'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='umip'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='md-clear'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibpb'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibrs'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='erms'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='lm'/>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='custom' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>qemu64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>qemu32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>phenom</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>n270</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>kvm64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>coreduo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>core2duo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>athlon</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Westmere</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Snowridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Penryn</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G5</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G4</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G1</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Nehalem</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Rome</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Milan</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Dhyana</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cooperlake</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Conroe</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>486</model>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:   </cpu>
Nov 16 17:55:34 user nova-compute[75342]:   <memoryBacking supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='sourceType'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>file</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>anonymous</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>memfd</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:   </memoryBacking>
Nov 16 17:55:34 user nova-compute[75342]:   <devices>
Nov 16 17:55:34 user nova-compute[75342]:     <disk supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='diskDevice'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>disk</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cdrom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>floppy</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>lun</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='bus'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ide</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>fdc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sata</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </disk>
Nov 16 17:55:34 user nova-compute[75342]:     <graphics supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sdl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vnc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>spice</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egl-headless</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </graphics>
Nov 16 17:55:34 user nova-compute[75342]:     <video supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='modelType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cirrus</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vmvga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>qxl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>none</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>bochs</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ramfb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </video>
Nov 16 17:55:34 user nova-compute[75342]:     <hostdev supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='mode'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>subsystem</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='startupPolicy'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>default</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>mandatory</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>requisite</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>optional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='subsysType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pci</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='capsType'/>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='pciBackend'/>
Nov 16 17:55:34 user nova-compute[75342]:     </hostdev>
Nov 16 17:55:34 user nova-compute[75342]:     <rng supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>random</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egd</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>builtin</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </rng>
Nov 16 17:55:34 user nova-compute[75342]:     <filesystem supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='driverType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>path</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>handle</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtiofs</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </filesystem>
Nov 16 17:55:34 user nova-compute[75342]:     <tpm supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-tis</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-crb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>passthrough</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>emulator</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </tpm>
Nov 16 17:55:34 user nova-compute[75342]:   </devices>
Nov 16 17:55:34 user nova-compute[75342]:   <features>
Nov 16 17:55:34 user nova-compute[75342]:     <gic supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     <vmcoreinfo supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <genid supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backingStoreInput supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backup supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <sev supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:   </features>
Nov 16 17:55:34 user nova-compute[75342]: </domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:  {{(pid=75342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 16 17:55:34 user nova-compute[75342]: <domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 17:55:34 user nova-compute[75342]:   <domain>kvm</domain>
Nov 16 17:55:34 user nova-compute[75342]:   <machine>pc-q35-jammy</machine>
Nov 16 17:55:34 user nova-compute[75342]:   <arch>i686</arch>
Nov 16 17:55:34 user nova-compute[75342]:   <vcpu max='288'/>
Nov 16 17:55:34 user nova-compute[75342]:   <iothreads supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:   <os supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='firmware'/>
Nov 16 17:55:34 user nova-compute[75342]:     <loader supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>rom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pflash</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='readonly'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>yes</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='secure'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </loader>
Nov 16 17:55:34 user nova-compute[75342]:   </os>
Nov 16 17:55:34 user nova-compute[75342]:   <cpu>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-passthrough' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='hostPassthroughMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='maximum' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='maximumMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-model' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <vendor>Intel</vendor>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ss'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='vmx'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pcid'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='hypervisor'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arat'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='umip'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='md-clear'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibpb'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibrs'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='erms'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='lm'/>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='custom' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>qemu64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>qemu32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>phenom</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>n270</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>kvm64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>coreduo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>core2duo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>athlon</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Westmere</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Snowridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Penryn</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G5</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G4</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G1</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Nehalem</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Rome</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Milan</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Dhyana</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cooperlake</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Conroe</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>486</model>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:   </cpu>
Nov 16 17:55:34 user nova-compute[75342]:   <memoryBacking supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='sourceType'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>file</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>anonymous</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>memfd</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:   </memoryBacking>
Nov 16 17:55:34 user nova-compute[75342]:   <devices>
Nov 16 17:55:34 user nova-compute[75342]:     <disk supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='diskDevice'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>disk</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cdrom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>floppy</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>lun</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='bus'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>fdc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sata</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </disk>
Nov 16 17:55:34 user nova-compute[75342]:     <graphics supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sdl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vnc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>spice</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egl-headless</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </graphics>
Nov 16 17:55:34 user nova-compute[75342]:     <video supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='modelType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cirrus</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vmvga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>qxl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>none</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>bochs</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ramfb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </video>
Nov 16 17:55:34 user nova-compute[75342]:     <hostdev supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='mode'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>subsystem</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='startupPolicy'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>default</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>mandatory</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>requisite</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>optional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='subsysType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pci</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='capsType'/>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='pciBackend'/>
Nov 16 17:55:34 user nova-compute[75342]:     </hostdev>
Nov 16 17:55:34 user nova-compute[75342]:     <rng supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>random</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egd</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>builtin</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </rng>
Nov 16 17:55:34 user nova-compute[75342]:     <filesystem supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='driverType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>path</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>handle</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtiofs</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </filesystem>
Nov 16 17:55:34 user nova-compute[75342]:     <tpm supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-tis</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-crb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>passthrough</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>emulator</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </tpm>
Nov 16 17:55:34 user nova-compute[75342]:   </devices>
Nov 16 17:55:34 user nova-compute[75342]:   <features>
Nov 16 17:55:34 user nova-compute[75342]:     <gic supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     <vmcoreinfo supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <genid supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backingStoreInput supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backup supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <sev supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:   </features>
Nov 16 17:55:34 user nova-compute[75342]: </domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:  {{(pid=75342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 16 17:55:34 user nova-compute[75342]: <domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 17:55:34 user nova-compute[75342]:   <domain>kvm</domain>
Nov 16 17:55:34 user nova-compute[75342]:   <machine>pc-i440fx-jammy</machine>
Nov 16 17:55:34 user nova-compute[75342]:   <arch>i686</arch>
Nov 16 17:55:34 user nova-compute[75342]:   <vcpu max='255'/>
Nov 16 17:55:34 user nova-compute[75342]:   <iothreads supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:   <os supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='firmware'/>
Nov 16 17:55:34 user nova-compute[75342]:     <loader supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>rom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pflash</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='readonly'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>yes</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='secure'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </loader>
Nov 16 17:55:34 user nova-compute[75342]:   </os>
Nov 16 17:55:34 user nova-compute[75342]:   <cpu>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-passthrough' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='hostPassthroughMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='maximum' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='maximumMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-model' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <vendor>Intel</vendor>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ss'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='vmx'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pcid'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='hypervisor'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arat'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='umip'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='md-clear'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibpb'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibrs'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='erms'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='lm'/>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='custom' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>qemu64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>qemu32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>phenom</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>n270</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>kvm64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>coreduo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>core2duo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>athlon</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Westmere</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Snowridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Penryn</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G5</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G4</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G1</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Nehalem</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Rome</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Milan</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Dhyana</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cooperlake</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Conroe</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>486</model>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:   </cpu>
Nov 16 17:55:34 user nova-compute[75342]:   <memoryBacking supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='sourceType'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>file</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>anonymous</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>memfd</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:   </memoryBacking>
Nov 16 17:55:34 user nova-compute[75342]:   <devices>
Nov 16 17:55:34 user nova-compute[75342]:     <disk supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='diskDevice'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>disk</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cdrom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>floppy</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>lun</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='bus'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ide</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>fdc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sata</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </disk>
Nov 16 17:55:34 user nova-compute[75342]:     <graphics supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sdl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vnc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>spice</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egl-headless</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </graphics>
Nov 16 17:55:34 user nova-compute[75342]:     <video supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='modelType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cirrus</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vmvga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>qxl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>none</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>bochs</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ramfb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </video>
Nov 16 17:55:34 user nova-compute[75342]:     <hostdev supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='mode'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>subsystem</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='startupPolicy'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>default</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>mandatory</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>requisite</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>optional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='subsysType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pci</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='capsType'/>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='pciBackend'/>
Nov 16 17:55:34 user nova-compute[75342]:     </hostdev>
Nov 16 17:55:34 user nova-compute[75342]:     <rng supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>random</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egd</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>builtin</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </rng>
Nov 16 17:55:34 user nova-compute[75342]:     <filesystem supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='driverType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>path</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>handle</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtiofs</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </filesystem>
Nov 16 17:55:34 user nova-compute[75342]:     <tpm supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-tis</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-crb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>passthrough</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>emulator</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </tpm>
Nov 16 17:55:34 user nova-compute[75342]:   </devices>
Nov 16 17:55:34 user nova-compute[75342]:   <features>
Nov 16 17:55:34 user nova-compute[75342]:     <gic supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     <vmcoreinfo supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <genid supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backingStoreInput supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backup supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <sev supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:   </features>
Nov 16 17:55:34 user nova-compute[75342]: </domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:  {{(pid=75342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 16 17:55:34 user nova-compute[75342]: <domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 17:55:34 user nova-compute[75342]:   <domain>kvm</domain>
Nov 16 17:55:34 user nova-compute[75342]:   <machine>pc-q35-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:   <arch>x86_64</arch>
Nov 16 17:55:34 user nova-compute[75342]:   <vcpu max='288'/>
Nov 16 17:55:34 user nova-compute[75342]:   <iothreads supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:   <os supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='firmware'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>efi</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:     <loader supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>rom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pflash</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='readonly'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>yes</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='secure'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>yes</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </loader>
Nov 16 17:55:34 user nova-compute[75342]:   </os>
Nov 16 17:55:34 user nova-compute[75342]:   <cpu>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-passthrough' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='hostPassthroughMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='maximum' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='maximumMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-model' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <vendor>Intel</vendor>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ss'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='vmx'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pcid'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='hypervisor'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arat'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='umip'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='md-clear'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='invtsc'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibpb'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibrs'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='rsba'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='erms'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='custom' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>qemu64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>qemu32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>phenom</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>n270</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>coreduo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>core2duo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>athlon</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Westmere</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Snowridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Penryn</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G5</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G4</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Opteron_G1</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Nehalem</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Rome</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Milan</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Dhyana</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cooperlake</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Conroe</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>486</model>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:   </cpu>
Nov 16 17:55:34 user nova-compute[75342]:   <memoryBacking supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='sourceType'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>file</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>anonymous</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>memfd</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:   </memoryBacking>
Nov 16 17:55:34 user nova-compute[75342]:   <devices>
Nov 16 17:55:34 user nova-compute[75342]:     <disk supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='diskDevice'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>disk</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cdrom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>floppy</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>lun</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='bus'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>fdc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sata</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </disk>
Nov 16 17:55:34 user nova-compute[75342]:     <graphics supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sdl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vnc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>spice</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egl-headless</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </graphics>
Nov 16 17:55:34 user nova-compute[75342]:     <video supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='modelType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cirrus</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vmvga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>qxl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>none</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>bochs</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ramfb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </video>
Nov 16 17:55:34 user nova-compute[75342]:     <hostdev supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='mode'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>subsystem</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='startupPolicy'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>default</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>mandatory</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>requisite</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>optional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='subsysType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pci</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='capsType'/>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='pciBackend'/>
Nov 16 17:55:34 user nova-compute[75342]:     </hostdev>
Nov 16 17:55:34 user nova-compute[75342]:     <rng supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>random</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egd</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>builtin</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </rng>
Nov 16 17:55:34 user nova-compute[75342]:     <filesystem supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='driverType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>path</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>handle</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtiofs</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </filesystem>
Nov 16 17:55:34 user nova-compute[75342]:     <tpm supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-tis</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-crb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>passthrough</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>emulator</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </tpm>
Nov 16 17:55:34 user nova-compute[75342]:   </devices>
Nov 16 17:55:34 user nova-compute[75342]:   <features>
Nov 16 17:55:34 user nova-compute[75342]:     <gic supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     <vmcoreinfo supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <genid supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backingStoreInput supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backup supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <sev supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:   </features>
Nov 16 17:55:34 user nova-compute[75342]: </domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:  {{(pid=75342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 16 17:55:34 user nova-compute[75342]: <domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 17:55:34 user nova-compute[75342]:   <domain>kvm</domain>
Nov 16 17:55:34 user nova-compute[75342]:   <machine>pc-i440fx-6.2</machine>
Nov 16 17:55:34 user nova-compute[75342]:   <arch>x86_64</arch>
Nov 16 17:55:34 user nova-compute[75342]:   <vcpu max='255'/>
Nov 16 17:55:34 user nova-compute[75342]:   <iothreads supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:   <os supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='firmware'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>efi</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:     <loader supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>rom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pflash</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='readonly'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>yes</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='secure'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </loader>
Nov 16 17:55:34 user nova-compute[75342]:   </os>
Nov 16 17:55:34 user nova-compute[75342]:   <cpu>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-passthrough' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='hostPassthroughMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='maximum' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='maximumMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-model' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <vendor>Intel</vendor>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ss'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='vmx'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pcid'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='hypervisor'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arat'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='umip'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='md-clear'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='invtsc'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibpb'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibrs'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='rsba'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='erms'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='custom' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>qemu64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>qemu32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>phenom</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>n270</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>coreduo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>core2duo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>athlon</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Westmere</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Snowridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Penryn</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G5</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G4</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Opteron_G1</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Nehalem</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Rome</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Milan</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Dhyana</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cooperlake</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Conroe</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>486</model>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:   </cpu>
Nov 16 17:55:34 user nova-compute[75342]:   <memoryBacking supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='sourceType'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>file</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>anonymous</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>memfd</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:   </memoryBacking>
Nov 16 17:55:34 user nova-compute[75342]:   <devices>
Nov 16 17:55:34 user nova-compute[75342]:     <disk supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='diskDevice'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>disk</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cdrom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>floppy</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>lun</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='bus'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ide</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>fdc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sata</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </disk>
Nov 16 17:55:34 user nova-compute[75342]:     <graphics supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sdl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vnc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>spice</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egl-headless</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </graphics>
Nov 16 17:55:34 user nova-compute[75342]:     <video supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='modelType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cirrus</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vmvga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>qxl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>none</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>bochs</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ramfb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </video>
Nov 16 17:55:34 user nova-compute[75342]:     <hostdev supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='mode'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>subsystem</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='startupPolicy'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>default</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>mandatory</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>requisite</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>optional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='subsysType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pci</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='capsType'/>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='pciBackend'/>
Nov 16 17:55:34 user nova-compute[75342]:     </hostdev>
Nov 16 17:55:34 user nova-compute[75342]:     <rng supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>random</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egd</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>builtin</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </rng>
Nov 16 17:55:34 user nova-compute[75342]:     <filesystem supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='driverType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>path</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>handle</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtiofs</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </filesystem>
Nov 16 17:55:34 user nova-compute[75342]:     <tpm supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-tis</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-crb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>passthrough</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>emulator</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </tpm>
Nov 16 17:55:34 user nova-compute[75342]:   </devices>
Nov 16 17:55:34 user nova-compute[75342]:   <features>
Nov 16 17:55:34 user nova-compute[75342]:     <gic supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     <vmcoreinfo supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <genid supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backingStoreInput supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backup supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <sev supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:   </features>
Nov 16 17:55:34 user nova-compute[75342]: </domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:  {{(pid=75342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 16 17:55:34 user nova-compute[75342]: <domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 17:55:34 user nova-compute[75342]:   <domain>kvm</domain>
Nov 16 17:55:34 user nova-compute[75342]:   <machine>pc-q35-jammy</machine>
Nov 16 17:55:34 user nova-compute[75342]:   <arch>x86_64</arch>
Nov 16 17:55:34 user nova-compute[75342]:   <vcpu max='288'/>
Nov 16 17:55:34 user nova-compute[75342]:   <iothreads supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:   <os supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='firmware'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>efi</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:     <loader supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>rom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pflash</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='readonly'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>yes</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='secure'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>yes</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </loader>
Nov 16 17:55:34 user nova-compute[75342]:   </os>
Nov 16 17:55:34 user nova-compute[75342]:   <cpu>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-passthrough' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='hostPassthroughMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='maximum' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='maximumMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-model' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <vendor>Intel</vendor>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ss'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='vmx'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pcid'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='hypervisor'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arat'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='umip'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='md-clear'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='invtsc'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibpb'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibrs'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='rsba'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='erms'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='custom' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>qemu64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>qemu32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>phenom</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>n270</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>coreduo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>core2duo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>athlon</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Westmere</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Snowridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Penryn</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G5</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G4</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Opteron_G1</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Nehalem</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Rome</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Milan</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Dhyana</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cooperlake</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Conroe</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>486</model>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:   </cpu>
Nov 16 17:55:34 user nova-compute[75342]:   <memoryBacking supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='sourceType'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>file</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>anonymous</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>memfd</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:   </memoryBacking>
Nov 16 17:55:34 user nova-compute[75342]:   <devices>
Nov 16 17:55:34 user nova-compute[75342]:     <disk supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='diskDevice'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>disk</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cdrom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>floppy</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>lun</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='bus'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>fdc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sata</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </disk>
Nov 16 17:55:34 user nova-compute[75342]:     <graphics supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sdl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vnc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>spice</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egl-headless</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </graphics>
Nov 16 17:55:34 user nova-compute[75342]:     <video supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='modelType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cirrus</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vmvga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>qxl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>none</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>bochs</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ramfb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </video>
Nov 16 17:55:34 user nova-compute[75342]:     <hostdev supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='mode'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>subsystem</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='startupPolicy'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>default</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>mandatory</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>requisite</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>optional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='subsysType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pci</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='capsType'/>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='pciBackend'/>
Nov 16 17:55:34 user nova-compute[75342]:     </hostdev>
Nov 16 17:55:34 user nova-compute[75342]:     <rng supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>random</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egd</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>builtin</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </rng>
Nov 16 17:55:34 user nova-compute[75342]:     <filesystem supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='driverType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>path</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>handle</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtiofs</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </filesystem>
Nov 16 17:55:34 user nova-compute[75342]:     <tpm supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-tis</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-crb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>passthrough</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>emulator</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </tpm>
Nov 16 17:55:34 user nova-compute[75342]:   </devices>
Nov 16 17:55:34 user nova-compute[75342]:   <features>
Nov 16 17:55:34 user nova-compute[75342]:     <gic supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     <vmcoreinfo supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <genid supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backingStoreInput supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backup supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <sev supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:   </features>
Nov 16 17:55:34 user nova-compute[75342]: </domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:  {{(pid=75342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 16 17:55:34 user nova-compute[75342]: <domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 17:55:34 user nova-compute[75342]:   <domain>kvm</domain>
Nov 16 17:55:34 user nova-compute[75342]:   <machine>pc-i440fx-jammy</machine>
Nov 16 17:55:34 user nova-compute[75342]:   <arch>x86_64</arch>
Nov 16 17:55:34 user nova-compute[75342]:   <vcpu max='255'/>
Nov 16 17:55:34 user nova-compute[75342]:   <iothreads supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:   <os supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='firmware'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>efi</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:     <loader supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>rom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pflash</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='readonly'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>yes</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='secure'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>no</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </loader>
Nov 16 17:55:34 user nova-compute[75342]:   </os>
Nov 16 17:55:34 user nova-compute[75342]:   <cpu>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-passthrough' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='hostPassthroughMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='maximum' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='maximumMigratable'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>on</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>off</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='host-model' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <vendor>Intel</vendor>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ss'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='vmx'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pcid'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='hypervisor'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arat'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='umip'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='md-clear'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='invtsc'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibpb'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='ibrs'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-stibp'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='rsba'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='erms'/>
Nov 16 17:55:34 user nova-compute[75342]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:     <mode name='custom' supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>qemu64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>qemu32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>phenom</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>pentium</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>n270</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm64</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>kvm32</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>coreduo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>core2duo</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>athlon</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Westmere</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Snowridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Skylake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>SandyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Penryn</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G5</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G4</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G3</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Opteron_G2</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Opteron_G1</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Nehalem</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>IvyBridge</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Icelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Haswell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Rome</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-Milan</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>EPYC</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Dhyana</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cooperlake</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>Conroe</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='no'>Broadwell</model>
Nov 16 17:55:34 user nova-compute[75342]:       <model usable='yes'>486</model>
Nov 16 17:55:34 user nova-compute[75342]:     </mode>
Nov 16 17:55:34 user nova-compute[75342]:   </cpu>
Nov 16 17:55:34 user nova-compute[75342]:   <memoryBacking supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:     <enum name='sourceType'>
Nov 16 17:55:34 user nova-compute[75342]:       <value>file</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>anonymous</value>
Nov 16 17:55:34 user nova-compute[75342]:       <value>memfd</value>
Nov 16 17:55:34 user nova-compute[75342]:     </enum>
Nov 16 17:55:34 user nova-compute[75342]:   </memoryBacking>
Nov 16 17:55:34 user nova-compute[75342]:   <devices>
Nov 16 17:55:34 user nova-compute[75342]:     <disk supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='diskDevice'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>disk</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cdrom</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>floppy</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>lun</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='bus'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ide</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>fdc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sata</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </disk>
Nov 16 17:55:34 user nova-compute[75342]:     <graphics supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='type'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>sdl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vnc</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>spice</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egl-headless</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </graphics>
Nov 16 17:55:34 user nova-compute[75342]:     <video supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='modelType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>cirrus</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>vmvga</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>qxl</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>none</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>bochs</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>ramfb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </video>
Nov 16 17:55:34 user nova-compute[75342]:     <hostdev supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='mode'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>subsystem</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='startupPolicy'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>default</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>mandatory</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>requisite</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>optional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='subsysType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>usb</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>pci</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>scsi</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='capsType'/>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='pciBackend'/>
Nov 16 17:55:34 user nova-compute[75342]:     </hostdev>
Nov 16 17:55:34 user nova-compute[75342]:     <rng supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtio-non-transitional</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>random</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>egd</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>builtin</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </rng>
Nov 16 17:55:34 user nova-compute[75342]:     <filesystem supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='driverType'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>path</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>handle</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>virtiofs</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </filesystem>
Nov 16 17:55:34 user nova-compute[75342]:     <tpm supported='yes'>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='model'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-tis</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>tpm-crb</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:       <enum name='backendModel'>
Nov 16 17:55:34 user nova-compute[75342]:         <value>passthrough</value>
Nov 16 17:55:34 user nova-compute[75342]:         <value>emulator</value>
Nov 16 17:55:34 user nova-compute[75342]:       </enum>
Nov 16 17:55:34 user nova-compute[75342]:     </tpm>
Nov 16 17:55:34 user nova-compute[75342]:   </devices>
Nov 16 17:55:34 user nova-compute[75342]:   <features>
Nov 16 17:55:34 user nova-compute[75342]:     <gic supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:     <vmcoreinfo supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <genid supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backingStoreInput supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <backup supported='yes'/>
Nov 16 17:55:34 user nova-compute[75342]:     <sev supported='no'/>
Nov 16 17:55:34 user nova-compute[75342]:   </features>
Nov 16 17:55:34 user nova-compute[75342]: </domainCapabilities>
Nov 16 17:55:34 user nova-compute[75342]:  {{(pid=75342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Checking secure boot support for host arch (x86_64) {{(pid=75342) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 17:55:34 user nova-compute[75342]: INFO nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Secure Boot support detected
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] cpu compare xml: <cpu match="exact">
Nov 16 17:55:34 user nova-compute[75342]:   <model>Nehalem</model>
Nov 16 17:55:34 user nova-compute[75342]: </cpu>
Nov 16 17:55:34 user nova-compute[75342]:  {{(pid=75342) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 16 17:55:34 user nova-compute[75342]: INFO nova.virt.node [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Generated node identity fdd6b940-75a0-4315-8416-79157aaeea59
Nov 16 17:55:34 user nova-compute[75342]: INFO nova.virt.node [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Wrote node identity fdd6b940-75a0-4315-8416-79157aaeea59 to /opt/stack/data/nova/compute_id
Nov 16 17:55:34 user nova-compute[75342]: WARNING nova.compute.manager [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Compute nodes ['fdd6b940-75a0-4315-8416-79157aaeea59'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 16 17:55:34 user nova-compute[75342]: INFO nova.compute.manager [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 16 17:55:34 user nova-compute[75342]: WARNING nova.compute.manager [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 17:55:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:55:34 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 17:55:35 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:55:35 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Hypervisor/Node resource view: name=user free_ram=10947MB free_disk=26.201080322265625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:55:35 user nova-compute[75342]: WARNING nova.compute.resource_tracker [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] No compute node record for user:fdd6b940-75a0-4315-8416-79157aaeea59: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host fdd6b940-75a0-4315-8416-79157aaeea59 could not be found.
Nov 16 17:55:35 user nova-compute[75342]: INFO nova.compute.resource_tracker [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Compute node record created for user:user with uuid: fdd6b940-75a0-4315-8416-79157aaeea59
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 17:55:35 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] [req-731e8339-0841-421e-806d-122d43dc525c] Created resource provider record via placement API for resource provider with UUID fdd6b940-75a0-4315-8416-79157aaeea59 and name user.
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75342) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 16 17:55:35 user nova-compute[75342]: INFO nova.virt.libvirt.host [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] kernel doesn't support AMD SEV
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Libvirt baseline CPU <cpu>
Nov 16 17:55:35 user nova-compute[75342]:   <arch>x86_64</arch>
Nov 16 17:55:35 user nova-compute[75342]:   <model>Nehalem</model>
Nov 16 17:55:35 user nova-compute[75342]:   <vendor>Intel</vendor>
Nov 16 17:55:35 user nova-compute[75342]:   <topology sockets="6" cores="1" threads="1"/>
Nov 16 17:55:35 user nova-compute[75342]: </cpu>
Nov 16 17:55:35 user nova-compute[75342]:  {{(pid=75342) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Updated inventory for provider fdd6b940-75a0-4315-8416-79157aaeea59 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Updating resource provider fdd6b940-75a0-4315-8416-79157aaeea59 generation from 0 to 1 during operation: update_inventory {{(pid=75342) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Updating resource provider fdd6b940-75a0-4315-8416-79157aaeea59 generation from 1 to 2 during operation: update_traits {{(pid=75342) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.719s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.service [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Creating RPC server for service compute {{(pid=75342) start /opt/stack/nova/nova/service.py:182}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.service [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] Join ServiceGroup membership for this service compute {{(pid=75342) start /opt/stack/nova/nova/service.py:199}}
Nov 16 17:55:35 user nova-compute[75342]: DEBUG nova.servicegroup.drivers.db [None req-34b77da8-6f76-4ff1-bc76-d0b29d6fe659 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75342) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 16 17:55:39 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:55:39 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 17:56:26 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:56:26 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:56:26 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=10377MB free_disk=26.104881286621094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 17:56:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:57:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:57:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:57:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:57:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:57:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 17:57:27 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:57:27 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:57:27 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=10316MB free_disk=26.170146942138672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 17:57:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:57:28 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:57:28 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:57:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 17:58:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:58:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:58:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:58:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 17:58:28 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:58:28 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:58:28 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=10308MB free_disk=25.921897888183594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 17:58:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:58:30 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:58:30 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:58:30 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 17:59:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:59:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:59:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:59:28 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:59:28 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 17:59:29 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:59:29 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:59:29 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=9658MB free_disk=25.950714111328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 17:59:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:30 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:59:30 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 17:59:30 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 17:59:30 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 17:59:30 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:59:30 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 17:59:30 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 17:59:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:41 user nova-compute[75342]: DEBUG nova.compute.manager [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 17:59:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 17:59:41 user nova-compute[75342]: INFO nova.compute.claims [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Claim successful on node user
Nov 16 17:59:41 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 17:59:41 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG nova.compute.manager [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG nova.compute.manager [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG nova.network.neutron [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 17:59:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 17:59:42 user nova-compute[75342]: DEBUG nova.compute.manager [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG nova.compute.manager [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 17:59:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Creating image(s)
Nov 16 17:59:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "/opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "/opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "/opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG nova.policy [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1794b9bef4ad42e6aab088f3ef90dba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78cae892fff433eb216caff3a127a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:42 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d.part --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 17:59:43 user nova-compute[75342]: INFO nova.compute.claims [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Claim successful on node user
Nov 16 17:59:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d.part --force-share --output=json" returned: 0 in 0.355s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG nova.virt.images [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] c3510820-8b2c-4ce9-a892-c10a662aeed6 was qcow2, converting to raw {{(pid=75342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d.part /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d.converted {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d.part /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d.converted" returned: 0 in 0.196s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d.converted --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 17:59:44 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 17:59:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 17:59:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 17:59:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.762s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:44 user nova-compute[75342]: INFO oslo.privsep.daemon [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_7elo5n2/privsep.sock']
Nov 16 17:59:44 user sudo[84607]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_7elo5n2/privsep.sock
Nov 16 17:59:44 user sudo[84607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 17:59:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 17:59:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 17:59:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Creating image(s)
Nov 16 17:59:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "/opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "/opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "/opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:44 user nova-compute[75342]: DEBUG nova.policy [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '243fe22891ae486fa79d3aeb79c9af99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be58a244a17c414fb222d6ed5d3a5c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 17:59:45 user nova-compute[75342]: INFO nova.compute.claims [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Claim successful on node user
Nov 16 17:59:45 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 17:59:45 user sudo[84607]: pam_unix(sudo:session): session closed for user root
Nov 16 17:59:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 17:59:45 user nova-compute[75342]: INFO oslo.privsep.daemon [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Spawned new privsep daemon via rootwrap
Nov 16 17:59:45 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 17:59:45 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 17:59:45 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 16 17:59:45 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84621
Nov 16 17:59:45 user nova-compute[75342]: WARNING oslo_privsep.priv_context [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] privsep daemon already running
Nov 16 17:59:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 17:59:45 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 17:59:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 17:59:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Successfully created port: 90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 17:59:46 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Creating image(s)
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "/opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "/opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk 1073741824" returned: 0 in 0.044s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.217s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.205s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.policy [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13beba5fa97a448fa863135a45e47cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542bb854a1647618ba3995c4342109a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.158s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.168s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk 1073741824" returned: 0 in 0.045s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.230s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Cannot resize image /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Ensure instance console log exists: /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.007s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.213s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk 1073741824" returned: 0 in 0.045s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Cannot resize image /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Ensure instance console log exists: /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 17:59:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:47 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Cannot resize image /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 17:59:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 17:59:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Ensure instance console log exists: /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 17:59:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Successfully created port: ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 17:59:48 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Successfully created port: dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Successfully updated port: 90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquired lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 17:59:49 user nova-compute[75342]: INFO nova.compute.claims [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Claim successful on node user
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-104a0f3a-15c3-40dc-9881-aed7c73dc5ff req-43ea944f-4f46-4faa-a178-3c718ff13fc5 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received event network-changed-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-104a0f3a-15c3-40dc-9881-aed7c73dc5ff req-43ea944f-4f46-4faa-a178-3c718ff13fc5 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Refreshing instance network info cache due to event network-changed-90788e52-2039-4374-bf9a-a77637f0752d. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-104a0f3a-15c3-40dc-9881-aed7c73dc5ff req-43ea944f-4f46-4faa-a178-3c718ff13fc5 service nova] Acquiring lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 17:59:49 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 17:59:49 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Creating image(s)
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "/opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "/opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "/opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.policy [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67704d03b80e4d709863960014fbcd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427ee24cf34d538c1b2ae19266b9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Successfully updated port: ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk 1073741824" returned: 0 in 0.053s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updating instance_info_cache with network_info: [{"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "refresh_cache-35052d56-cec1-4a07-84f4-a6f5b65bb9bd" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquired lock "refresh_cache-35052d56-cec1-4a07-84f4-a6f5b65bb9bd" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Releasing lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Instance network_info: |[{"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-104a0f3a-15c3-40dc-9881-aed7c73dc5ff req-43ea944f-4f46-4faa-a178-3c718ff13fc5 service nova] Acquired lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.network.neutron [req-104a0f3a-15c3-40dc-9881-aed7c73dc5ff req-43ea944f-4f46-4faa-a178-3c718ff13fc5 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Refreshing network info cache for port 90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Start _get_guest_xml network_info=[{"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 17:59:50 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:59:50 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-228468433',display_name='tempest-ServerActionsTestOtherA-server-228468433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-228468433',id=1,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU1men7gMttl3YEQ2iX5okVvx4lpe2gNM2yccK4kETnd8Mrupb252faDCsR3+7xPoiSo7c4DSoVxYlsKd1dOtU+J4xVhSH7sXMEH8ib246uK8ZL45kAm/O/eMxS5d6eeQ==',key_name='tempest-keypair-357673672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-rogh2o84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T17:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=85cd3e12-187f-48ba-9753-e8e93787cdf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=90788e52-2039-4374-bf9a-a77637f0752d,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90788e52-20') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.objects.instance [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'pci_devices' on Instance uuid 85cd3e12-187f-48ba-9753-e8e93787cdf4 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] End _get_guest_xml xml=<domain type="kvm">
Nov 16 17:59:50 user nova-compute[75342]:   <uuid>85cd3e12-187f-48ba-9753-e8e93787cdf4</uuid>
Nov 16 17:59:50 user nova-compute[75342]:   <name>instance-00000001</name>
Nov 16 17:59:50 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 17:59:50 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 17:59:50 user nova-compute[75342]:   <metadata>
Nov 16 17:59:50 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 17:59:50 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 17:59:50 user nova-compute[75342]:       <nova:name>tempest-ServerActionsTestOtherA-server-228468433</nova:name>
Nov 16 17:59:50 user nova-compute[75342]:       <nova:creationTime>2023-11-16 17:59:50</nova:creationTime>
Nov 16 17:59:50 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 17:59:50 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 17:59:50 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 17:59:50 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 17:59:50 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 17:59:50 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 17:59:50 user nova-compute[75342]:       </nova:flavor>
Nov 16 17:59:50 user nova-compute[75342]:       <nova:owner>
Nov 16 17:59:50 user nova-compute[75342]:         <nova:user uuid="1794b9bef4ad42e6aab088f3ef90dba2">tempest-ServerActionsTestOtherA-1650562087-project-member</nova:user>
Nov 16 17:59:50 user nova-compute[75342]:         <nova:project uuid="c78cae892fff433eb216caff3a127a64">tempest-ServerActionsTestOtherA-1650562087</nova:project>
Nov 16 17:59:50 user nova-compute[75342]:       </nova:owner>
Nov 16 17:59:50 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 17:59:50 user nova-compute[75342]:       <nova:ports>
Nov 16 17:59:50 user nova-compute[75342]:         <nova:port uuid="90788e52-2039-4374-bf9a-a77637f0752d">
Nov 16 17:59:50 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 17:59:50 user nova-compute[75342]:         </nova:port>
Nov 16 17:59:50 user nova-compute[75342]:       </nova:ports>
Nov 16 17:59:50 user nova-compute[75342]:     </nova:instance>
Nov 16 17:59:50 user nova-compute[75342]:   </metadata>
Nov 16 17:59:50 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 17:59:50 user nova-compute[75342]:     <system>
Nov 16 17:59:50 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 17:59:50 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 17:59:50 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 17:59:50 user nova-compute[75342]:       <entry name="serial">85cd3e12-187f-48ba-9753-e8e93787cdf4</entry>
Nov 16 17:59:50 user nova-compute[75342]:       <entry name="uuid">85cd3e12-187f-48ba-9753-e8e93787cdf4</entry>
Nov 16 17:59:50 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 17:59:50 user nova-compute[75342]:     </system>
Nov 16 17:59:50 user nova-compute[75342]:   </sysinfo>
Nov 16 17:59:50 user nova-compute[75342]:   <os>
Nov 16 17:59:50 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 17:59:50 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 17:59:50 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 17:59:50 user nova-compute[75342]:   </os>
Nov 16 17:59:50 user nova-compute[75342]:   <features>
Nov 16 17:59:50 user nova-compute[75342]:     <acpi/>
Nov 16 17:59:50 user nova-compute[75342]:     <apic/>
Nov 16 17:59:50 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 17:59:50 user nova-compute[75342]:   </features>
Nov 16 17:59:50 user nova-compute[75342]:   <clock offset="utc">
Nov 16 17:59:50 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 17:59:50 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 17:59:50 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 17:59:50 user nova-compute[75342]:   </clock>
Nov 16 17:59:50 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 17:59:50 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 17:59:50 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 17:59:50 user nova-compute[75342]:   </cpu>
Nov 16 17:59:50 user nova-compute[75342]:   <devices>
Nov 16 17:59:50 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 17:59:50 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 17:59:50 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk"/>
Nov 16 17:59:50 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 17:59:50 user nova-compute[75342]:     </disk>
Nov 16 17:59:50 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 17:59:50 user nova-compute[75342]:       <mac address="fa:16:3e:7a:80:ac"/>
Nov 16 17:59:50 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 17:59:50 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 17:59:50 user nova-compute[75342]:       <target dev="tap90788e52-20"/>
Nov 16 17:59:50 user nova-compute[75342]:     </interface>
Nov 16 17:59:50 user nova-compute[75342]:     <serial type="pty">
Nov 16 17:59:50 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/console.log" append="off"/>
Nov 16 17:59:50 user nova-compute[75342]:     </serial>
Nov 16 17:59:50 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 17:59:50 user nova-compute[75342]:     <video>
Nov 16 17:59:50 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 17:59:50 user nova-compute[75342]:     </video>
Nov 16 17:59:50 user nova-compute[75342]:     <rng model="virtio">
Nov 16 17:59:50 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 17:59:50 user nova-compute[75342]:     </rng>
Nov 16 17:59:50 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 17:59:50 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 17:59:50 user nova-compute[75342]:       <stats period="10"/>
Nov 16 17:59:50 user nova-compute[75342]:     </memballoon>
Nov 16 17:59:50 user nova-compute[75342]:   </devices>
Nov 16 17:59:50 user nova-compute[75342]: </domain>
Nov 16 17:59:50 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-228468433',display_name='tempest-ServerActionsTestOtherA-server-228468433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-228468433',id=1,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU1men7gMttl3YEQ2iX5okVvx4lpe2gNM2yccK4kETnd8Mrupb252faDCsR3+7xPoiSo7c4DSoVxYlsKd1dOtU+J4xVhSH7sXMEH8ib246uK8ZL45kAm/O/eMxS5d6eeQ==',key_name='tempest-keypair-357673672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-rogh2o84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T17:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=85cd3e12-187f-48ba-9753-e8e93787cdf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=90788e52-2039-4374-bf9a-a77637f0752d,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90788e52-20') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG os_vif [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=90788e52-2039-4374-bf9a-a77637f0752d,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90788e52-20') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.208s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Created schema index Interface.name {{(pid=75342) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Created schema index Port.name {{(pid=75342) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Created schema index Bridge.name {{(pid=75342) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [POLLOUT] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Cannot resize image /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Ensure instance console log exists: /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a26d1dfe-2967-58bd-9d0e-5c9793c40efc', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 17:59:50 user nova-compute[75342]: INFO oslo.privsep.daemon [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp34ch4cw_/privsep.sock']
Nov 16 17:59:50 user sudo[84709]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp34ch4cw_/privsep.sock
Nov 16 17:59:50 user sudo[84709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 17:59:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-78cb15ca-68c6-4a77-943b-d2f416746552 req-03ee12c7-f64a-4ff4-84a3-801e5ca8c9ac service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Received event network-changed-ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-78cb15ca-68c6-4a77-943b-d2f416746552 req-03ee12c7-f64a-4ff4-84a3-801e5ca8c9ac service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Refreshing instance network info cache due to event network-changed-ad751606-e2b6-4e87-8e84-b52e103606ad. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78cb15ca-68c6-4a77-943b-d2f416746552 req-03ee12c7-f64a-4ff4-84a3-801e5ca8c9ac service nova] Acquiring lock "refresh_cache-35052d56-cec1-4a07-84f4-a6f5b65bb9bd" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Updating instance_info_cache with network_info: [{"id": "ad751606-e2b6-4e87-8e84-b52e103606ad", "address": "fa:16:3e:70:86:1d", "network": {"id": "2e3be18f-3a5d-476c-95cf-2b04ce1bee1f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-858330362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be58a244a17c414fb222d6ed5d3a5c87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad751606-e2", "ovs_interfaceid": "ad751606-e2b6-4e87-8e84-b52e103606ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Releasing lock "refresh_cache-35052d56-cec1-4a07-84f4-a6f5b65bb9bd" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Instance network_info: |[{"id": "ad751606-e2b6-4e87-8e84-b52e103606ad", "address": "fa:16:3e:70:86:1d", "network": {"id": "2e3be18f-3a5d-476c-95cf-2b04ce1bee1f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-858330362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be58a244a17c414fb222d6ed5d3a5c87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad751606-e2", "ovs_interfaceid": "ad751606-e2b6-4e87-8e84-b52e103606ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78cb15ca-68c6-4a77-943b-d2f416746552 req-03ee12c7-f64a-4ff4-84a3-801e5ca8c9ac service nova] Acquired lock "refresh_cache-35052d56-cec1-4a07-84f4-a6f5b65bb9bd" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-78cb15ca-68c6-4a77-943b-d2f416746552 req-03ee12c7-f64a-4ff4-84a3-801e5ca8c9ac service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Refreshing network info cache for port ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Start _get_guest_xml network_info=[{"id": "ad751606-e2b6-4e87-8e84-b52e103606ad", "address": "fa:16:3e:70:86:1d", "network": {"id": "2e3be18f-3a5d-476c-95cf-2b04ce1bee1f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-858330362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be58a244a17c414fb222d6ed5d3a5c87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad751606-e2", "ovs_interfaceid": "ad751606-e2b6-4e87-8e84-b52e103606ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 17:59:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:59:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-371218078',display_name='tempest-DeleteServersTestJSON-server-371218078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-371218078',id=2,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be58a244a17c414fb222d6ed5d3a5c87',ramdisk_id='',reservation_id='r-fmho2hb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-51749853',owner_user_name='tempest-DeleteServersTestJSON-51749853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T17:59:44Z,user_data=None,user_id='243fe22891ae486fa79d3aeb79c9af99',uuid=35052d56-cec1-4a07-84f4-a6f5b65bb9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad751606-e2b6-4e87-8e84-b52e103606ad", "address": "fa:16:3e:70:86:1d", "network": {"id": "2e3be18f-3a5d-476c-95cf-2b04ce1bee1f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-858330362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be58a244a17c414fb222d6ed5d3a5c87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad751606-e2", "ovs_interfaceid": "ad751606-e2b6-4e87-8e84-b52e103606ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Converting VIF {"id": "ad751606-e2b6-4e87-8e84-b52e103606ad", "address": "fa:16:3e:70:86:1d", "network": {"id": "2e3be18f-3a5d-476c-95cf-2b04ce1bee1f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-858330362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be58a244a17c414fb222d6ed5d3a5c87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad751606-e2", "ovs_interfaceid": "ad751606-e2b6-4e87-8e84-b52e103606ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:86:1d,bridge_name='br-int',has_traffic_filtering=True,id=ad751606-e2b6-4e87-8e84-b52e103606ad,network=Network(2e3be18f-3a5d-476c-95cf-2b04ce1bee1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad751606-e2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lazy-loading 'pci_devices' on Instance uuid 35052d56-cec1-4a07-84f4-a6f5b65bb9bd {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Successfully updated port: dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] End _get_guest_xml xml=<domain type="kvm">
Nov 16 17:59:51 user nova-compute[75342]:   <uuid>35052d56-cec1-4a07-84f4-a6f5b65bb9bd</uuid>
Nov 16 17:59:51 user nova-compute[75342]:   <name>instance-00000002</name>
Nov 16 17:59:51 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 17:59:51 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 17:59:51 user nova-compute[75342]:   <metadata>
Nov 16 17:59:51 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 17:59:51 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 17:59:51 user nova-compute[75342]:       <nova:name>tempest-DeleteServersTestJSON-server-371218078</nova:name>
Nov 16 17:59:51 user nova-compute[75342]:       <nova:creationTime>2023-11-16 17:59:51</nova:creationTime>
Nov 16 17:59:51 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 17:59:51 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 17:59:51 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 17:59:51 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 17:59:51 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 17:59:51 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 17:59:51 user nova-compute[75342]:       </nova:flavor>
Nov 16 17:59:51 user nova-compute[75342]:       <nova:owner>
Nov 16 17:59:51 user nova-compute[75342]:         <nova:user uuid="243fe22891ae486fa79d3aeb79c9af99">tempest-DeleteServersTestJSON-51749853-project-member</nova:user>
Nov 16 17:59:51 user nova-compute[75342]:         <nova:project uuid="be58a244a17c414fb222d6ed5d3a5c87">tempest-DeleteServersTestJSON-51749853</nova:project>
Nov 16 17:59:51 user nova-compute[75342]:       </nova:owner>
Nov 16 17:59:51 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 17:59:51 user nova-compute[75342]:       <nova:ports>
Nov 16 17:59:51 user nova-compute[75342]:         <nova:port uuid="ad751606-e2b6-4e87-8e84-b52e103606ad">
Nov 16 17:59:51 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 17:59:51 user nova-compute[75342]:         </nova:port>
Nov 16 17:59:51 user nova-compute[75342]:       </nova:ports>
Nov 16 17:59:51 user nova-compute[75342]:     </nova:instance>
Nov 16 17:59:51 user nova-compute[75342]:   </metadata>
Nov 16 17:59:51 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 17:59:51 user nova-compute[75342]:     <system>
Nov 16 17:59:51 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 17:59:51 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 17:59:51 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 17:59:51 user nova-compute[75342]:       <entry name="serial">35052d56-cec1-4a07-84f4-a6f5b65bb9bd</entry>
Nov 16 17:59:51 user nova-compute[75342]:       <entry name="uuid">35052d56-cec1-4a07-84f4-a6f5b65bb9bd</entry>
Nov 16 17:59:51 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 17:59:51 user nova-compute[75342]:     </system>
Nov 16 17:59:51 user nova-compute[75342]:   </sysinfo>
Nov 16 17:59:51 user nova-compute[75342]:   <os>
Nov 16 17:59:51 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 17:59:51 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 17:59:51 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 17:59:51 user nova-compute[75342]:   </os>
Nov 16 17:59:51 user nova-compute[75342]:   <features>
Nov 16 17:59:51 user nova-compute[75342]:     <acpi/>
Nov 16 17:59:51 user nova-compute[75342]:     <apic/>
Nov 16 17:59:51 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 17:59:51 user nova-compute[75342]:   </features>
Nov 16 17:59:51 user nova-compute[75342]:   <clock offset="utc">
Nov 16 17:59:51 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 17:59:51 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 17:59:51 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 17:59:51 user nova-compute[75342]:   </clock>
Nov 16 17:59:51 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 17:59:51 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 17:59:51 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 17:59:51 user nova-compute[75342]:   </cpu>
Nov 16 17:59:51 user nova-compute[75342]:   <devices>
Nov 16 17:59:51 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 17:59:51 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 17:59:51 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk"/>
Nov 16 17:59:51 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 17:59:51 user nova-compute[75342]:     </disk>
Nov 16 17:59:51 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 17:59:51 user nova-compute[75342]:       <mac address="fa:16:3e:70:86:1d"/>
Nov 16 17:59:51 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 17:59:51 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 17:59:51 user nova-compute[75342]:       <target dev="tapad751606-e2"/>
Nov 16 17:59:51 user nova-compute[75342]:     </interface>
Nov 16 17:59:51 user nova-compute[75342]:     <serial type="pty">
Nov 16 17:59:51 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/console.log" append="off"/>
Nov 16 17:59:51 user nova-compute[75342]:     </serial>
Nov 16 17:59:51 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 17:59:51 user nova-compute[75342]:     <video>
Nov 16 17:59:51 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 17:59:51 user nova-compute[75342]:     </video>
Nov 16 17:59:51 user nova-compute[75342]:     <rng model="virtio">
Nov 16 17:59:51 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 17:59:51 user nova-compute[75342]:     </rng>
Nov 16 17:59:51 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 17:59:51 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 17:59:51 user nova-compute[75342]:       <stats period="10"/>
Nov 16 17:59:51 user nova-compute[75342]:     </memballoon>
Nov 16 17:59:51 user nova-compute[75342]:   </devices>
Nov 16 17:59:51 user nova-compute[75342]: </domain>
Nov 16 17:59:51 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-371218078',display_name='tempest-DeleteServersTestJSON-server-371218078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-371218078',id=2,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be58a244a17c414fb222d6ed5d3a5c87',ramdisk_id='',reservation_id='r-fmho2hb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-51749853',owner_user_name='tempest-DeleteServersTestJSON-51749853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T17:59:44Z,user_data=None,user_id='243fe22891ae486fa79d3aeb79c9af99',uuid=35052d56-cec1-4a07-84f4-a6f5b65bb9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad751606-e2b6-4e87-8e84-b52e103606ad", "address": "fa:16:3e:70:86:1d", "network": {"id": "2e3be18f-3a5d-476c-95cf-2b04ce1bee1f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-858330362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be58a244a17c414fb222d6ed5d3a5c87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad751606-e2", "ovs_interfaceid": "ad751606-e2b6-4e87-8e84-b52e103606ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Converting VIF {"id": "ad751606-e2b6-4e87-8e84-b52e103606ad", "address": "fa:16:3e:70:86:1d", "network": {"id": "2e3be18f-3a5d-476c-95cf-2b04ce1bee1f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-858330362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be58a244a17c414fb222d6ed5d3a5c87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad751606-e2", "ovs_interfaceid": "ad751606-e2b6-4e87-8e84-b52e103606ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:86:1d,bridge_name='br-int',has_traffic_filtering=True,id=ad751606-e2b6-4e87-8e84-b52e103606ad,network=Network(2e3be18f-3a5d-476c-95cf-2b04ce1bee1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad751606-e2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG os_vif [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:86:1d,bridge_name='br-int',has_traffic_filtering=True,id=ad751606-e2b6-4e87-8e84-b52e103606ad,network=Network(2e3be18f-3a5d-476c-95cf-2b04ce1bee1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad751606-e2') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '697b8147-bb0f-50d7-af33-10fc898532ca', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquired lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 17:59:52 user sudo[84709]: pam_unix(sudo:session): session closed for user root
Nov 16 17:59:52 user nova-compute[75342]: INFO oslo.privsep.daemon [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Spawned new privsep daemon via rootwrap
Nov 16 17:59:52 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 17:59:52 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 17:59:52 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 16 17:59:52 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84712
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:52 user nova-compute[75342]: WARNING oslo_privsep.priv_context [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] privsep daemon already running
Nov 16 17:59:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-ae5f8c8e-40e2-4be3-add1-b4d53538478e req-7321379e-654f-4442-9623-c2aa716f1206 service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Received event network-changed-dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-ae5f8c8e-40e2-4be3-add1-b4d53538478e req-7321379e-654f-4442-9623-c2aa716f1206 service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Refreshing instance network info cache due to event network-changed-dfb89038-19a3-4873-83f9-a6dac7b334f9. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ae5f8c8e-40e2-4be3-add1-b4d53538478e req-7321379e-654f-4442-9623-c2aa716f1206 service nova] Acquiring lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG nova.network.neutron [req-104a0f3a-15c3-40dc-9881-aed7c73dc5ff req-43ea944f-4f46-4faa-a178-3c718ff13fc5 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updated VIF entry in instance network info cache for port 90788e52-2039-4374-bf9a-a77637f0752d. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG nova.network.neutron [req-104a0f3a-15c3-40dc-9881-aed7c73dc5ff req-43ea944f-4f46-4faa-a178-3c718ff13fc5 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updating instance_info_cache with network_info: [{"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-104a0f3a-15c3-40dc-9881-aed7c73dc5ff req-43ea944f-4f46-4faa-a178-3c718ff13fc5 service nova] Releasing lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90788e52-20, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90788e52-20, col_values=(('qos', UUID('6556247b-2a96-4345-9dd7-156b0f95e91d')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90788e52-20, col_values=(('external_ids', {'iface-id': '90788e52-2039-4374-bf9a-a77637f0752d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:80:ac', 'vm-uuid': '85cd3e12-187f-48ba-9753-e8e93787cdf4'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:52 user nova-compute[75342]: INFO os_vif [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=90788e52-2039-4374-bf9a-a77637f0752d,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90788e52-20')
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad751606-e2, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad751606-e2, col_values=(('qos', UUID('95499f64-0991-433b-bb59-7af1f8dc7814')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad751606-e2, col_values=(('external_ids', {'iface-id': 'ad751606-e2b6-4e87-8e84-b52e103606ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:86:1d', 'vm-uuid': '35052d56-cec1-4a07-84f4-a6f5b65bb9bd'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:52 user nova-compute[75342]: INFO os_vif [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:86:1d,bridge_name='br-int',has_traffic_filtering=True,id=ad751606-e2b6-4e87-8e84-b52e103606ad,network=Network(2e3be18f-3a5d-476c-95cf-2b04ce1bee1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad751606-e2')
Nov 16 17:59:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No VIF found with MAC fa:16:3e:7a:80:ac, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] No VIF found with MAC fa:16:3e:70:86:1d, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 17:59:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.network.neutron [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Successfully created port: b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.network.neutron [req-78cb15ca-68c6-4a77-943b-d2f416746552 req-03ee12c7-f64a-4ff4-84a3-801e5ca8c9ac service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Updated VIF entry in instance network info cache for port ad751606-e2b6-4e87-8e84-b52e103606ad. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.network.neutron [req-78cb15ca-68c6-4a77-943b-d2f416746552 req-03ee12c7-f64a-4ff4-84a3-801e5ca8c9ac service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Updating instance_info_cache with network_info: [{"id": "ad751606-e2b6-4e87-8e84-b52e103606ad", "address": "fa:16:3e:70:86:1d", "network": {"id": "2e3be18f-3a5d-476c-95cf-2b04ce1bee1f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-858330362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be58a244a17c414fb222d6ed5d3a5c87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad751606-e2", "ovs_interfaceid": "ad751606-e2b6-4e87-8e84-b52e103606ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78cb15ca-68c6-4a77-943b-d2f416746552 req-03ee12c7-f64a-4ff4-84a3-801e5ca8c9ac service nova] Releasing lock "refresh_cache-35052d56-cec1-4a07-84f4-a6f5b65bb9bd" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Updating instance_info_cache with network_info: [{"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Releasing lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Instance network_info: |[{"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ae5f8c8e-40e2-4be3-add1-b4d53538478e req-7321379e-654f-4442-9623-c2aa716f1206 service nova] Acquired lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.network.neutron [req-ae5f8c8e-40e2-4be3-add1-b4d53538478e req-7321379e-654f-4442-9623-c2aa716f1206 service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Refreshing network info cache for port dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Start _get_guest_xml network_info=[{"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 17:59:53 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:59:53 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1765059888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1765059888',id=3,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-0rom0ub2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T17:59:46Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=0c54066f-8fa7-4279-b62e-64614b01d6b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:77,bridge_name='br-int',has_traffic_filtering=True,id=dfb89038-19a3-4873-83f9-a6dac7b334f9,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb89038-19') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.objects.instance [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c54066f-8fa7-4279-b62e-64614b01d6b1 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 17:59:53 user nova-compute[75342]:   <uuid>0c54066f-8fa7-4279-b62e-64614b01d6b1</uuid>
Nov 16 17:59:53 user nova-compute[75342]:   <name>instance-00000003</name>
Nov 16 17:59:53 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 17:59:53 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 17:59:53 user nova-compute[75342]:   <metadata>
Nov 16 17:59:53 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 17:59:53 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 17:59:53 user nova-compute[75342]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1765059888</nova:name>
Nov 16 17:59:53 user nova-compute[75342]:       <nova:creationTime>2023-11-16 17:59:53</nova:creationTime>
Nov 16 17:59:53 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 17:59:53 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 17:59:53 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 17:59:53 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 17:59:53 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 17:59:53 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 17:59:53 user nova-compute[75342]:       </nova:flavor>
Nov 16 17:59:53 user nova-compute[75342]:       <nova:owner>
Nov 16 17:59:53 user nova-compute[75342]:         <nova:user uuid="13beba5fa97a448fa863135a45e47cb9">tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member</nova:user>
Nov 16 17:59:53 user nova-compute[75342]:         <nova:project uuid="4542bb854a1647618ba3995c4342109a">tempest-ServerBootFromVolumeStableRescueTest-764398626</nova:project>
Nov 16 17:59:53 user nova-compute[75342]:       </nova:owner>
Nov 16 17:59:53 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 17:59:53 user nova-compute[75342]:       <nova:ports>
Nov 16 17:59:53 user nova-compute[75342]:         <nova:port uuid="dfb89038-19a3-4873-83f9-a6dac7b334f9">
Nov 16 17:59:53 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 17:59:53 user nova-compute[75342]:         </nova:port>
Nov 16 17:59:53 user nova-compute[75342]:       </nova:ports>
Nov 16 17:59:53 user nova-compute[75342]:     </nova:instance>
Nov 16 17:59:53 user nova-compute[75342]:   </metadata>
Nov 16 17:59:53 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 17:59:53 user nova-compute[75342]:     <system>
Nov 16 17:59:53 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 17:59:53 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 17:59:53 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 17:59:53 user nova-compute[75342]:       <entry name="serial">0c54066f-8fa7-4279-b62e-64614b01d6b1</entry>
Nov 16 17:59:53 user nova-compute[75342]:       <entry name="uuid">0c54066f-8fa7-4279-b62e-64614b01d6b1</entry>
Nov 16 17:59:53 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 17:59:53 user nova-compute[75342]:     </system>
Nov 16 17:59:53 user nova-compute[75342]:   </sysinfo>
Nov 16 17:59:53 user nova-compute[75342]:   <os>
Nov 16 17:59:53 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 17:59:53 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 17:59:53 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 17:59:53 user nova-compute[75342]:   </os>
Nov 16 17:59:53 user nova-compute[75342]:   <features>
Nov 16 17:59:53 user nova-compute[75342]:     <acpi/>
Nov 16 17:59:53 user nova-compute[75342]:     <apic/>
Nov 16 17:59:53 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 17:59:53 user nova-compute[75342]:   </features>
Nov 16 17:59:53 user nova-compute[75342]:   <clock offset="utc">
Nov 16 17:59:53 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 17:59:53 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 17:59:53 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 17:59:53 user nova-compute[75342]:   </clock>
Nov 16 17:59:53 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 17:59:53 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 17:59:53 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 17:59:53 user nova-compute[75342]:   </cpu>
Nov 16 17:59:53 user nova-compute[75342]:   <devices>
Nov 16 17:59:53 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 17:59:53 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 17:59:53 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk"/>
Nov 16 17:59:53 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 17:59:53 user nova-compute[75342]:     </disk>
Nov 16 17:59:53 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 17:59:53 user nova-compute[75342]:       <mac address="fa:16:3e:cb:2f:77"/>
Nov 16 17:59:53 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 17:59:53 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 17:59:53 user nova-compute[75342]:       <target dev="tapdfb89038-19"/>
Nov 16 17:59:53 user nova-compute[75342]:     </interface>
Nov 16 17:59:53 user nova-compute[75342]:     <serial type="pty">
Nov 16 17:59:53 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/console.log" append="off"/>
Nov 16 17:59:53 user nova-compute[75342]:     </serial>
Nov 16 17:59:53 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 17:59:53 user nova-compute[75342]:     <video>
Nov 16 17:59:53 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 17:59:53 user nova-compute[75342]:     </video>
Nov 16 17:59:53 user nova-compute[75342]:     <rng model="virtio">
Nov 16 17:59:53 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 17:59:53 user nova-compute[75342]:     </rng>
Nov 16 17:59:53 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 17:59:53 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 17:59:53 user nova-compute[75342]:       <stats period="10"/>
Nov 16 17:59:53 user nova-compute[75342]:     </memballoon>
Nov 16 17:59:53 user nova-compute[75342]:   </devices>
Nov 16 17:59:53 user nova-compute[75342]: </domain>
Nov 16 17:59:53 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1765059888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1765059888',id=3,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-0rom0ub2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T17:59:46Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=0c54066f-8fa7-4279-b62e-64614b01d6b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:77,bridge_name='br-int',has_traffic_filtering=True,id=dfb89038-19a3-4873-83f9-a6dac7b334f9,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb89038-19') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG os_vif [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:77,bridge_name='br-int',has_traffic_filtering=True,id=dfb89038-19a3-4873-83f9-a6dac7b334f9,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb89038-19') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ede295a9-bc79-5e7a-a656-b49b06a5932b', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfb89038-19, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfb89038-19, col_values=(('qos', UUID('e0a28502-4135-44fd-9cc7-2301a25529cf')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfb89038-19, col_values=(('external_ids', {'iface-id': 'dfb89038-19a3-4873-83f9-a6dac7b334f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:2f:77', 'vm-uuid': '0c54066f-8fa7-4279-b62e-64614b01d6b1'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 17:59:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:53 user nova-compute[75342]: INFO os_vif [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:2f:77,bridge_name='br-int',has_traffic_filtering=True,id=dfb89038-19a3-4873-83f9-a6dac7b334f9,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb89038-19')
Nov 16 17:59:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No VIF found with MAC fa:16:3e:cb:2f:77, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG nova.network.neutron [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Successfully updated port: b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-88f5ddc8-4aae-46cd-8188-4546fb7663d6 req-9688e0d3-a5f9-4cb5-8f18-a69d5b8dc094 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-changed-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-88f5ddc8-4aae-46cd-8188-4546fb7663d6 req-9688e0d3-a5f9-4cb5-8f18-a69d5b8dc094 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Refreshing instance network info cache due to event network-changed-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-88f5ddc8-4aae-46cd-8188-4546fb7663d6 req-9688e0d3-a5f9-4cb5-8f18-a69d5b8dc094 service nova] Acquiring lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-88f5ddc8-4aae-46cd-8188-4546fb7663d6 req-9688e0d3-a5f9-4cb5-8f18-a69d5b8dc094 service nova] Acquired lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-88f5ddc8-4aae-46cd-8188-4546fb7663d6 req-9688e0d3-a5f9-4cb5-8f18-a69d5b8dc094 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Refreshing network info cache for port b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-88f5ddc8-4aae-46cd-8188-4546fb7663d6 req-9688e0d3-a5f9-4cb5-8f18-a69d5b8dc094 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-88f5ddc8-4aae-46cd-8188-4546fb7663d6 req-9688e0d3-a5f9-4cb5-8f18-a69d5b8dc094 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-88f5ddc8-4aae-46cd-8188-4546fb7663d6 req-9688e0d3-a5f9-4cb5-8f18-a69d5b8dc094 service nova] Releasing lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquired lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 17:59:54 user nova-compute[75342]: DEBUG nova.network.neutron [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.network.neutron [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.network.neutron [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating instance_info_cache with network_info: [{"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Releasing lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.compute.manager [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance network_info: |[{"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Start _get_guest_xml network_info=[{"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 17:59:55 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:59:55 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1606614034',display_name='tempest-ServerActionsTestOtherB-server-1606614034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1606614034',id=4,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1UyBGifbaRVIIusr59UKLEcXLfyd6epVSgRuItUg0lc3AijdYFqlIZoLMbi5dO5JpMBiHIhBKHMDap+u4RdhUKBD/7ZLtWgtZhiB+iJEQy+7uabGfTLiM4pLG8U3m+Tg==',key_name='tempest-keypair-290385198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f427ee24cf34d538c1b2ae19266b9f3',ramdisk_id='',reservation_id='r-v0hi3c4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-613458522',owner_user_name='tempest-ServerActionsTestOtherB-613458522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T17:59:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67704d03b80e4d709863960014fbcd24',uuid=2992b5fc-86e6-425f-82e5-cf6358582872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converting VIF {"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.objects.instance [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lazy-loading 'pci_devices' on Instance uuid 2992b5fc-86e6-425f-82e5-cf6358582872 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] End _get_guest_xml xml=<domain type="kvm">
Nov 16 17:59:55 user nova-compute[75342]:   <uuid>2992b5fc-86e6-425f-82e5-cf6358582872</uuid>
Nov 16 17:59:55 user nova-compute[75342]:   <name>instance-00000004</name>
Nov 16 17:59:55 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 17:59:55 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 17:59:55 user nova-compute[75342]:   <metadata>
Nov 16 17:59:55 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 17:59:55 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 17:59:55 user nova-compute[75342]:       <nova:name>tempest-ServerActionsTestOtherB-server-1606614034</nova:name>
Nov 16 17:59:55 user nova-compute[75342]:       <nova:creationTime>2023-11-16 17:59:55</nova:creationTime>
Nov 16 17:59:55 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 17:59:55 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 17:59:55 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 17:59:55 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 17:59:55 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 17:59:55 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 17:59:55 user nova-compute[75342]:       </nova:flavor>
Nov 16 17:59:55 user nova-compute[75342]:       <nova:owner>
Nov 16 17:59:55 user nova-compute[75342]:         <nova:user uuid="67704d03b80e4d709863960014fbcd24">tempest-ServerActionsTestOtherB-613458522-project-member</nova:user>
Nov 16 17:59:55 user nova-compute[75342]:         <nova:project uuid="2f427ee24cf34d538c1b2ae19266b9f3">tempest-ServerActionsTestOtherB-613458522</nova:project>
Nov 16 17:59:55 user nova-compute[75342]:       </nova:owner>
Nov 16 17:59:55 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 17:59:55 user nova-compute[75342]:       <nova:ports>
Nov 16 17:59:55 user nova-compute[75342]:         <nova:port uuid="b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf">
Nov 16 17:59:55 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 17:59:55 user nova-compute[75342]:         </nova:port>
Nov 16 17:59:55 user nova-compute[75342]:       </nova:ports>
Nov 16 17:59:55 user nova-compute[75342]:     </nova:instance>
Nov 16 17:59:55 user nova-compute[75342]:   </metadata>
Nov 16 17:59:55 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 17:59:55 user nova-compute[75342]:     <system>
Nov 16 17:59:55 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 17:59:55 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 17:59:55 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 17:59:55 user nova-compute[75342]:       <entry name="serial">2992b5fc-86e6-425f-82e5-cf6358582872</entry>
Nov 16 17:59:55 user nova-compute[75342]:       <entry name="uuid">2992b5fc-86e6-425f-82e5-cf6358582872</entry>
Nov 16 17:59:55 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 17:59:55 user nova-compute[75342]:     </system>
Nov 16 17:59:55 user nova-compute[75342]:   </sysinfo>
Nov 16 17:59:55 user nova-compute[75342]:   <os>
Nov 16 17:59:55 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 17:59:55 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 17:59:55 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 17:59:55 user nova-compute[75342]:   </os>
Nov 16 17:59:55 user nova-compute[75342]:   <features>
Nov 16 17:59:55 user nova-compute[75342]:     <acpi/>
Nov 16 17:59:55 user nova-compute[75342]:     <apic/>
Nov 16 17:59:55 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 17:59:55 user nova-compute[75342]:   </features>
Nov 16 17:59:55 user nova-compute[75342]:   <clock offset="utc">
Nov 16 17:59:55 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 17:59:55 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 17:59:55 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 17:59:55 user nova-compute[75342]:   </clock>
Nov 16 17:59:55 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 17:59:55 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 17:59:55 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 17:59:55 user nova-compute[75342]:   </cpu>
Nov 16 17:59:55 user nova-compute[75342]:   <devices>
Nov 16 17:59:55 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 17:59:55 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 17:59:55 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk"/>
Nov 16 17:59:55 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 17:59:55 user nova-compute[75342]:     </disk>
Nov 16 17:59:55 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 17:59:55 user nova-compute[75342]:       <mac address="fa:16:3e:f5:5a:de"/>
Nov 16 17:59:55 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 17:59:55 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 17:59:55 user nova-compute[75342]:       <target dev="tapb2a1cbd5-36"/>
Nov 16 17:59:55 user nova-compute[75342]:     </interface>
Nov 16 17:59:55 user nova-compute[75342]:     <serial type="pty">
Nov 16 17:59:55 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/console.log" append="off"/>
Nov 16 17:59:55 user nova-compute[75342]:     </serial>
Nov 16 17:59:55 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 17:59:55 user nova-compute[75342]:     <video>
Nov 16 17:59:55 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 17:59:55 user nova-compute[75342]:     </video>
Nov 16 17:59:55 user nova-compute[75342]:     <rng model="virtio">
Nov 16 17:59:55 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 17:59:55 user nova-compute[75342]:     </rng>
Nov 16 17:59:55 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 17:59:55 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 17:59:55 user nova-compute[75342]:       <stats period="10"/>
Nov 16 17:59:55 user nova-compute[75342]:     </memballoon>
Nov 16 17:59:55 user nova-compute[75342]:   </devices>
Nov 16 17:59:55 user nova-compute[75342]: </domain>
Nov 16 17:59:55 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1606614034',display_name='tempest-ServerActionsTestOtherB-server-1606614034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1606614034',id=4,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1UyBGifbaRVIIusr59UKLEcXLfyd6epVSgRuItUg0lc3AijdYFqlIZoLMbi5dO5JpMBiHIhBKHMDap+u4RdhUKBD/7ZLtWgtZhiB+iJEQy+7uabGfTLiM4pLG8U3m+Tg==',key_name='tempest-keypair-290385198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f427ee24cf34d538c1b2ae19266b9f3',ramdisk_id='',reservation_id='r-v0hi3c4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-613458522',owner_user_name='tempest-ServerActionsTestOtherB-613458522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T17:59:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67704d03b80e4d709863960014fbcd24',uuid=2992b5fc-86e6-425f-82e5-cf6358582872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converting VIF {"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG os_vif [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1a2f0a8-4f6c-5c3f-91bf-257adf98a023', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2a1cbd5-36, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2a1cbd5-36, col_values=(('qos', UUID('d1135e6a-a951-4026-9642-f482a274d645')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2a1cbd5-36, col_values=(('external_ids', {'iface-id': 'b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:5a:de', 'vm-uuid': '2992b5fc-86e6-425f-82e5-cf6358582872'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:55 user nova-compute[75342]: INFO os_vif [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36')
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] No VIF found with MAC fa:16:3e:f5:5a:de, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-ae5f8c8e-40e2-4be3-add1-b4d53538478e req-7321379e-654f-4442-9623-c2aa716f1206 service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Updated VIF entry in instance network info cache for port dfb89038-19a3-4873-83f9-a6dac7b334f9. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-ae5f8c8e-40e2-4be3-add1-b4d53538478e req-7321379e-654f-4442-9623-c2aa716f1206 service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Updating instance_info_cache with network_info: [{"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ae5f8c8e-40e2-4be3-add1-b4d53538478e req-7321379e-654f-4442-9623-c2aa716f1206 service nova] Releasing lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 17:59:57 user nova-compute[75342]: INFO nova.compute.claims [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Claim successful on node user
Nov 16 17:59:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 17:59:57 user nova-compute[75342]: DEBUG nova.network.neutron [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 17:59:57 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 17:59:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 17:59:58 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Creating image(s)
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "/opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "/opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "/opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG nova.policy [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f21531e56db949a0a0a30925635a35d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1f044ccaee41cfa073d66a26578f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-2124b559-00a7-498e-bdb9-901f12811e59 req-19747b06-952e-43fa-8ead-038d24b1cfbf service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Received event network-vif-plugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2124b559-00a7-498e-bdb9-901f12811e59 req-19747b06-952e-43fa-8ead-038d24b1cfbf service nova] Acquiring lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2124b559-00a7-498e-bdb9-901f12811e59 req-19747b06-952e-43fa-8ead-038d24b1cfbf service nova] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2124b559-00a7-498e-bdb9-901f12811e59 req-19747b06-952e-43fa-8ead-038d24b1cfbf service nova] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-2124b559-00a7-498e-bdb9-901f12811e59 req-19747b06-952e-43fa-8ead-038d24b1cfbf service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] No waiting events found dispatching network-vif-plugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 17:59:58 user nova-compute[75342]: WARNING nova.compute.manager [req-2124b559-00a7-498e-bdb9-901f12811e59 req-19747b06-952e-43fa-8ead-038d24b1cfbf service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Received unexpected event network-vif-plugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 for instance with vm_state building and task_state spawning.
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.163s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk 1073741824" returned: 0 in 0.042s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.164s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Cannot resize image /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Ensure instance console log exists: /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 17:59:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.network.neutron [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Successfully created port: 8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Instance spawned successfully.
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-d0caeb27-b289-4113-bc51-0ea3257035c0 req-a1a015e5-008c-4216-bac0-869cfa54c15f service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Received event network-vif-plugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d0caeb27-b289-4113-bc51-0ea3257035c0 req-a1a015e5-008c-4216-bac0-869cfa54c15f service nova] Acquiring lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d0caeb27-b289-4113-bc51-0ea3257035c0 req-a1a015e5-008c-4216-bac0-869cfa54c15f service nova] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d0caeb27-b289-4113-bc51-0ea3257035c0 req-a1a015e5-008c-4216-bac0-869cfa54c15f service nova] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-d0caeb27-b289-4113-bc51-0ea3257035c0 req-a1a015e5-008c-4216-bac0-869cfa54c15f service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] No waiting events found dispatching network-vif-plugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:00 user nova-compute[75342]: WARNING nova.compute.manager [req-d0caeb27-b289-4113-bc51-0ea3257035c0 req-a1a015e5-008c-4216-bac0-869cfa54c15f service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Received unexpected event network-vif-plugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 for instance with vm_state building and task_state spawning.
Nov 16 18:00:00 user nova-compute[75342]: INFO nova.compute.manager [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Took 17.90 seconds to spawn the instance on the hypervisor.
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:00:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Instance spawned successfully.
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:00:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Instance spawned successfully.
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: INFO nova.compute.manager [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Took 19.16 seconds to build instance.
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-682d8fba-0286-41dc-8429-dedc46dad151 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.408s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "e00c5b4b-e155-4513-bda3-7eea536e8742" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance spawned successfully.
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:00:00 user nova-compute[75342]: INFO nova.compute.manager [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Took 14.62 seconds to spawn the instance on the hypervisor.
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:01 user nova-compute[75342]: INFO nova.compute.manager [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Took 11.21 seconds to spawn the instance on the hypervisor.
Nov 16 18:00:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:00:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:01 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:00:01 user nova-compute[75342]: INFO nova.compute.claims [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Claim successful on node user
Nov 16 18:00:01 user nova-compute[75342]: INFO nova.compute.manager [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Took 15.99 seconds to build instance.
Nov 16 18:00:01 user nova-compute[75342]: INFO nova.compute.manager [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Took 17.05 seconds to spawn the instance on the hypervisor.
Nov 16 18:00:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:00:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf537c1d-2fae-45de-9bb6-5219cb27998f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.318s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:01 user nova-compute[75342]: INFO nova.compute.manager [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Took 12.48 seconds to build instance.
Nov 16 18:00:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-108b2d49-1f45-4c10-a935-db7ffb7f716b tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.637s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:01 user nova-compute[75342]: INFO nova.compute.manager [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Took 18.89 seconds to build instance.
Nov 16 18:00:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2119fa6a-f107-4591-beea-4f7880a159ec tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.089s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.222s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:00:02 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 16 18:00:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG nova.policy [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e107ad21c24043b7b56248c7c1e88c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84123b277d334ce38d98292f7178eea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:00:02 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Creating image(s)
Nov 16 18:00:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "/opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "/opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "/opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "88e21542f7e99c14674f9f6757edaa17a3848736" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "88e21542f7e99c14674f9f6757edaa17a3848736" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736.part --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Successfully updated port: 8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Successfully created port: ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquired lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-41b9477a-5db6-4294-841b-c830fc808dbd req-0105d600-bfe0-4997-9404-4fca3d765b89 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Received event network-changed-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-41b9477a-5db6-4294-841b-c830fc808dbd req-0105d600-bfe0-4997-9404-4fca3d765b89 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Refreshing instance network info cache due to event network-changed-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-41b9477a-5db6-4294-841b-c830fc808dbd req-0105d600-bfe0-4997-9404-4fca3d765b89 service nova] Acquiring lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736.part --force-share --output=json" returned: 0 in 0.284s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG nova.virt.images [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] 9f61628a-de96-4ff7-b90a-cc8a015073f4 was qcow2, converting to raw {{(pid=75342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:00:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736.part /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736.converted {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:04 user nova-compute[75342]: DEBUG nova.network.neutron [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736.part /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736.converted" returned: 0 in 0.757s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736.converted --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736.converted --force-share --output=json" returned: 0 in 0.257s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "88e21542f7e99c14674f9f6757edaa17a3848736" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.987s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736 --force-share --output=json" returned: 0 in 0.303s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "88e21542f7e99c14674f9f6757edaa17a3848736" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "88e21542f7e99c14674f9f6757edaa17a3848736" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Updating instance_info_cache with network_info: [{"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Releasing lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Instance network_info: |[{"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-41b9477a-5db6-4294-841b-c830fc808dbd req-0105d600-bfe0-4997-9404-4fca3d765b89 service nova] Acquired lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.network.neutron [req-41b9477a-5db6-4294-841b-c830fc808dbd req-0105d600-bfe0-4997-9404-4fca3d765b89 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Refreshing network info cache for port 8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Start _get_guest_xml network_info=[{"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:00:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1849285264',display_name='tempest-VolumesAdminNegativeTest-server-1849285264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1849285264',id=5,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrr5gp0zj9mZttbh8lJ4OVyu1SE8E6Tt+zTD43bVLjSQj+T7orVvgEM1C/qlfNR4COwu3piUubjvVI+cxLee3F813lYnvLK+tP+6nPsfSdR5x5UoTm1fEK+z4AHSuvUxw==',key_name='tempest-keypair-1748820997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d1f044ccaee41cfa073d66a26578f3d',ramdisk_id='',reservation_id='r-026ugqot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2111670408',owner_user_name='tempest-VolumesAdminNegativeTest-2111670408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T17:59:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21531e56db949a0a0a30925635a35d4',uuid=edfbe94c-988d-4fe3-a7d0-450ba54bf2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converting VIF {"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a8:f7,bridge_name='br-int',has_traffic_filtering=True,id=8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4cd90d-4d') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.objects.instance [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lazy-loading 'pci_devices' on Instance uuid edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Successfully updated port: ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736 --force-share --output=json" returned: 0 in 0.259s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736,backing_fmt=raw /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:00:05 user nova-compute[75342]:   <uuid>edfbe94c-988d-4fe3-a7d0-450ba54bf2c5</uuid>
Nov 16 18:00:05 user nova-compute[75342]:   <name>instance-00000005</name>
Nov 16 18:00:05 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:00:05 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:00:05 user nova-compute[75342]:   <metadata>
Nov 16 18:00:05 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:00:05 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:00:05 user nova-compute[75342]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1849285264</nova:name>
Nov 16 18:00:05 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:00:05</nova:creationTime>
Nov 16 18:00:05 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:00:05 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:00:05 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:00:05 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:00:05 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:00:05 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:00:05 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:00:05 user nova-compute[75342]:       <nova:owner>
Nov 16 18:00:05 user nova-compute[75342]:         <nova:user uuid="f21531e56db949a0a0a30925635a35d4">tempest-VolumesAdminNegativeTest-2111670408-project-member</nova:user>
Nov 16 18:00:05 user nova-compute[75342]:         <nova:project uuid="6d1f044ccaee41cfa073d66a26578f3d">tempest-VolumesAdminNegativeTest-2111670408</nova:project>
Nov 16 18:00:05 user nova-compute[75342]:       </nova:owner>
Nov 16 18:00:05 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:00:05 user nova-compute[75342]:       <nova:ports>
Nov 16 18:00:05 user nova-compute[75342]:         <nova:port uuid="8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754">
Nov 16 18:00:05 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 18:00:05 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:05 user nova-compute[75342]:       </nova:ports>
Nov 16 18:00:05 user nova-compute[75342]:     </nova:instance>
Nov 16 18:00:05 user nova-compute[75342]:   </metadata>
Nov 16 18:00:05 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:00:05 user nova-compute[75342]:     <system>
Nov 16 18:00:05 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:00:05 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:00:05 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:00:05 user nova-compute[75342]:       <entry name="serial">edfbe94c-988d-4fe3-a7d0-450ba54bf2c5</entry>
Nov 16 18:00:05 user nova-compute[75342]:       <entry name="uuid">edfbe94c-988d-4fe3-a7d0-450ba54bf2c5</entry>
Nov 16 18:00:05 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:00:05 user nova-compute[75342]:     </system>
Nov 16 18:00:05 user nova-compute[75342]:   </sysinfo>
Nov 16 18:00:05 user nova-compute[75342]:   <os>
Nov 16 18:00:05 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:00:05 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:00:05 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:00:05 user nova-compute[75342]:   </os>
Nov 16 18:00:05 user nova-compute[75342]:   <features>
Nov 16 18:00:05 user nova-compute[75342]:     <acpi/>
Nov 16 18:00:05 user nova-compute[75342]:     <apic/>
Nov 16 18:00:05 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:00:05 user nova-compute[75342]:   </features>
Nov 16 18:00:05 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:00:05 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:00:05 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:00:05 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:00:05 user nova-compute[75342]:   </clock>
Nov 16 18:00:05 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:00:05 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:00:05 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:00:05 user nova-compute[75342]:   </cpu>
Nov 16 18:00:05 user nova-compute[75342]:   <devices>
Nov 16 18:00:05 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:00:05 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:00:05 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk"/>
Nov 16 18:00:05 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:00:05 user nova-compute[75342]:     </disk>
Nov 16 18:00:05 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:05 user nova-compute[75342]:       <mac address="fa:16:3e:3c:a8:f7"/>
Nov 16 18:00:05 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:05 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:05 user nova-compute[75342]:       <target dev="tap8d4cd90d-4d"/>
Nov 16 18:00:05 user nova-compute[75342]:     </interface>
Nov 16 18:00:05 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:00:05 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/console.log" append="off"/>
Nov 16 18:00:05 user nova-compute[75342]:     </serial>
Nov 16 18:00:05 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:00:05 user nova-compute[75342]:     <video>
Nov 16 18:00:05 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:05 user nova-compute[75342]:     </video>
Nov 16 18:00:05 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:00:05 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:00:05 user nova-compute[75342]:     </rng>
Nov 16 18:00:05 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:00:05 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:00:05 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:00:05 user nova-compute[75342]:     </memballoon>
Nov 16 18:00:05 user nova-compute[75342]:   </devices>
Nov 16 18:00:05 user nova-compute[75342]: </domain>
Nov 16 18:00:05 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1849285264',display_name='tempest-VolumesAdminNegativeTest-server-1849285264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1849285264',id=5,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrr5gp0zj9mZttbh8lJ4OVyu1SE8E6Tt+zTD43bVLjSQj+T7orVvgEM1C/qlfNR4COwu3piUubjvVI+cxLee3F813lYnvLK+tP+6nPsfSdR5x5UoTm1fEK+z4AHSuvUxw==',key_name='tempest-keypair-1748820997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d1f044ccaee41cfa073d66a26578f3d',ramdisk_id='',reservation_id='r-026ugqot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2111670408',owner_user_name='tempest-VolumesAdminNegativeTest-2111670408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T17:59:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21531e56db949a0a0a30925635a35d4',uuid=edfbe94c-988d-4fe3-a7d0-450ba54bf2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converting VIF {"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a8:f7,bridge_name='br-int',has_traffic_filtering=True,id=8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4cd90d-4d') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG os_vif [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a8:f7,bridge_name='br-int',has_traffic_filtering=True,id=8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4cd90d-4d') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "refresh_cache-e00c5b4b-e155-4513-bda3-7eea536e8742" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquired lock "refresh_cache-e00c5b4b-e155-4513-bda3-7eea536e8742" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-557ebf21-6aab-481d-82ad-e9f0ec949bee req-6e86a7e5-7f94-4619-a70a-3198811298d8 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Received event network-changed-ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-557ebf21-6aab-481d-82ad-e9f0ec949bee req-6e86a7e5-7f94-4619-a70a-3198811298d8 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Refreshing instance network info cache due to event network-changed-ebf8ff34-740f-4344-9caf-aec4d0b51afc. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-557ebf21-6aab-481d-82ad-e9f0ec949bee req-6e86a7e5-7f94-4619-a70a-3198811298d8 service nova] Acquiring lock "refresh_cache-e00c5b4b-e155-4513-bda3-7eea536e8742" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736,backing_fmt=raw /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk 1073741824" returned: 0 in 0.091s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8354cf6c-ebdd-5174-9d54-a3b19d648074', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "88e21542f7e99c14674f9f6757edaa17a3848736" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d4cd90d-4d, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d4cd90d-4d, col_values=(('qos', UUID('f78ec149-66e7-4c41-b46e-2dfed74d76da')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d4cd90d-4d, col_values=(('external_ids', {'iface-id': '8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:a8:f7', 'vm-uuid': 'edfbe94c-988d-4fe3-a7d0-450ba54bf2c5'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:05 user nova-compute[75342]: INFO os_vif [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:a8:f7,bridge_name='br-int',has_traffic_filtering=True,id=8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4cd90d-4d')
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] No VIF found with MAC fa:16:3e:3c:a8:f7, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736 --force-share --output=json" returned: 0 in 0.328s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Cannot resize image /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Ensure instance console log exists: /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Updating instance_info_cache with network_info: [{"id": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "address": "fa:16:3e:4a:0c:36", "network": {"id": "bf70d248-3de6-4375-85f0-c7b29d766fc1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1928035521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84123b277d334ce38d98292f7178eea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf8ff34-74", "ovs_interfaceid": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Releasing lock "refresh_cache-e00c5b4b-e155-4513-bda3-7eea536e8742" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Instance network_info: |[{"id": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "address": "fa:16:3e:4a:0c:36", "network": {"id": "bf70d248-3de6-4375-85f0-c7b29d766fc1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1928035521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84123b277d334ce38d98292f7178eea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf8ff34-74", "ovs_interfaceid": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-557ebf21-6aab-481d-82ad-e9f0ec949bee req-6e86a7e5-7f94-4619-a70a-3198811298d8 service nova] Acquired lock "refresh_cache-e00c5b4b-e155-4513-bda3-7eea536e8742" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-557ebf21-6aab-481d-82ad-e9f0ec949bee req-6e86a7e5-7f94-4619-a70a-3198811298d8 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Refreshing network info cache for port ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Start _get_guest_xml network_info=[{"id": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "address": "fa:16:3e:4a:0c:36", "network": {"id": "bf70d248-3de6-4375-85f0-c7b29d766fc1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1928035521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84123b277d334ce38d98292f7178eea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf8ff34-74", "ovs_interfaceid": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:59:55Z,direct_url=<?>,disk_format='qcow2',id=9f61628a-de96-4ff7-b90a-cc8a015073f4,min_disk=0,min_ram=0,name='',owner='472865cbc09e4f24afaf228be4a677b5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:59:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/sda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': '9f61628a-de96-4ff7-b90a-cc8a015073f4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:00:06 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:06 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:59:55Z,direct_url=<?>,disk_format='qcow2',id=9f61628a-de96-4ff7-b90a-cc8a015073f4,min_disk=0,min_ram=0,name='',owner='472865cbc09e4f24afaf228be4a677b5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:59:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T17:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-212087695',display_name='tempest-AttachSCSIVolumeTestJSON-server-212087695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-212087695',id=6,image_ref='9f61628a-de96-4ff7-b90a-cc8a015073f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeyIDAbbVoglYEO59g97jZwGFjhdQy3pd6/TTiiFZUobB3tUBErOHSgPWhUK9Rusutz7vrXyEykPjbFHgUZRRBWlLzTDjVTO/Gs5BVCOUlaimCQoOVi5l4K9o7Qh+GYHQ==',key_name='tempest-keypair-90691677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84123b277d334ce38d98292f7178eea6',ramdisk_id='',reservation_id='r-0hr01sho',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f61628a-de96-4ff7-b90a-cc8a015073f4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-988371779',owner_user_name='tempest-AttachSCSIVolumeTestJSON-988371779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e107ad21c24043b7b56248c7c1e88c02',uuid=e00c5b4b-e155-4513-bda3-7eea536e8742,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "address": "fa:16:3e:4a:0c:36", "network": {"id": "bf70d248-3de6-4375-85f0-c7b29d766fc1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1928035521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84123b277d334ce38d98292f7178eea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf8ff34-74", "ovs_interfaceid": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Converting VIF {"id": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "address": "fa:16:3e:4a:0c:36", "network": {"id": "bf70d248-3de6-4375-85f0-c7b29d766fc1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1928035521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84123b277d334ce38d98292f7178eea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf8ff34-74", "ovs_interfaceid": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=ebf8ff34-740f-4344-9caf-aec4d0b51afc,network=Network(bf70d248-3de6-4375-85f0-c7b29d766fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf8ff34-74') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lazy-loading 'pci_devices' on Instance uuid e00c5b4b-e155-4513-bda3-7eea536e8742 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-41b9477a-5db6-4294-841b-c830fc808dbd req-0105d600-bfe0-4997-9404-4fca3d765b89 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Updated VIF entry in instance network info cache for port 8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-41b9477a-5db6-4294-841b-c830fc808dbd req-0105d600-bfe0-4997-9404-4fca3d765b89 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Updating instance_info_cache with network_info: [{"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:00:06 user nova-compute[75342]:   <uuid>e00c5b4b-e155-4513-bda3-7eea536e8742</uuid>
Nov 16 18:00:06 user nova-compute[75342]:   <name>instance-00000006</name>
Nov 16 18:00:06 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:00:06 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:00:06 user nova-compute[75342]:   <metadata>
Nov 16 18:00:06 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:00:06 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:00:06 user nova-compute[75342]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-212087695</nova:name>
Nov 16 18:00:06 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:00:06</nova:creationTime>
Nov 16 18:00:06 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:00:06 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:00:06 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:00:06 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:00:06 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:00:06 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:00:06 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:00:06 user nova-compute[75342]:       <nova:owner>
Nov 16 18:00:06 user nova-compute[75342]:         <nova:user uuid="e107ad21c24043b7b56248c7c1e88c02">tempest-AttachSCSIVolumeTestJSON-988371779-project-member</nova:user>
Nov 16 18:00:06 user nova-compute[75342]:         <nova:project uuid="84123b277d334ce38d98292f7178eea6">tempest-AttachSCSIVolumeTestJSON-988371779</nova:project>
Nov 16 18:00:06 user nova-compute[75342]:       </nova:owner>
Nov 16 18:00:06 user nova-compute[75342]:       <nova:root type="image" uuid="9f61628a-de96-4ff7-b90a-cc8a015073f4"/>
Nov 16 18:00:06 user nova-compute[75342]:       <nova:ports>
Nov 16 18:00:06 user nova-compute[75342]:         <nova:port uuid="ebf8ff34-740f-4344-9caf-aec4d0b51afc">
Nov 16 18:00:06 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 18:00:06 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:06 user nova-compute[75342]:       </nova:ports>
Nov 16 18:00:06 user nova-compute[75342]:     </nova:instance>
Nov 16 18:00:06 user nova-compute[75342]:   </metadata>
Nov 16 18:00:06 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:00:06 user nova-compute[75342]:     <system>
Nov 16 18:00:06 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:00:06 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:00:06 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:00:06 user nova-compute[75342]:       <entry name="serial">e00c5b4b-e155-4513-bda3-7eea536e8742</entry>
Nov 16 18:00:06 user nova-compute[75342]:       <entry name="uuid">e00c5b4b-e155-4513-bda3-7eea536e8742</entry>
Nov 16 18:00:06 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:00:06 user nova-compute[75342]:     </system>
Nov 16 18:00:06 user nova-compute[75342]:   </sysinfo>
Nov 16 18:00:06 user nova-compute[75342]:   <os>
Nov 16 18:00:06 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:00:06 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:00:06 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:00:06 user nova-compute[75342]:   </os>
Nov 16 18:00:06 user nova-compute[75342]:   <features>
Nov 16 18:00:06 user nova-compute[75342]:     <acpi/>
Nov 16 18:00:06 user nova-compute[75342]:     <apic/>
Nov 16 18:00:06 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:00:06 user nova-compute[75342]:   </features>
Nov 16 18:00:06 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:00:06 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:00:06 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:00:06 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:00:06 user nova-compute[75342]:   </clock>
Nov 16 18:00:06 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:00:06 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:00:06 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:00:06 user nova-compute[75342]:   </cpu>
Nov 16 18:00:06 user nova-compute[75342]:   <devices>
Nov 16 18:00:06 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:00:06 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:00:06 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk"/>
Nov 16 18:00:06 user nova-compute[75342]:       <target dev="sda" bus="scsi"/>
Nov 16 18:00:06 user nova-compute[75342]:       <address type="drive" controller="0" unit="0"/>
Nov 16 18:00:06 user nova-compute[75342]:     </disk>
Nov 16 18:00:06 user nova-compute[75342]:     <disk type="file" device="cdrom">
Nov 16 18:00:06 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 18:00:06 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk.config"/>
Nov 16 18:00:06 user nova-compute[75342]:       <target dev="sdb" bus="scsi"/>
Nov 16 18:00:06 user nova-compute[75342]:       <address type="drive" controller="0" unit="1"/>
Nov 16 18:00:06 user nova-compute[75342]:     </disk>
Nov 16 18:00:06 user nova-compute[75342]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 16 18:00:06 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:06 user nova-compute[75342]:       <mac address="fa:16:3e:4a:0c:36"/>
Nov 16 18:00:06 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:06 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:06 user nova-compute[75342]:       <target dev="tapebf8ff34-74"/>
Nov 16 18:00:06 user nova-compute[75342]:     </interface>
Nov 16 18:00:06 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:00:06 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/console.log" append="off"/>
Nov 16 18:00:06 user nova-compute[75342]:     </serial>
Nov 16 18:00:06 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:00:06 user nova-compute[75342]:     <video>
Nov 16 18:00:06 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:06 user nova-compute[75342]:     </video>
Nov 16 18:00:06 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:00:06 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:00:06 user nova-compute[75342]:     </rng>
Nov 16 18:00:06 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:00:06 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:00:06 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:00:06 user nova-compute[75342]:     </memballoon>
Nov 16 18:00:06 user nova-compute[75342]:   </devices>
Nov 16 18:00:06 user nova-compute[75342]: </domain>
Nov 16 18:00:06 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T17:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-212087695',display_name='tempest-AttachSCSIVolumeTestJSON-server-212087695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-212087695',id=6,image_ref='9f61628a-de96-4ff7-b90a-cc8a015073f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeyIDAbbVoglYEO59g97jZwGFjhdQy3pd6/TTiiFZUobB3tUBErOHSgPWhUK9Rusutz7vrXyEykPjbFHgUZRRBWlLzTDjVTO/Gs5BVCOUlaimCQoOVi5l4K9o7Qh+GYHQ==',key_name='tempest-keypair-90691677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84123b277d334ce38d98292f7178eea6',ramdisk_id='',reservation_id='r-0hr01sho',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f61628a-de96-4ff7-b90a-cc8a015073f4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-988371779',owner_user_name='tempest-AttachSCSIVolumeTestJSON-988371779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e107ad21c24043b7b56248c7c1e88c02',uuid=e00c5b4b-e155-4513-bda3-7eea536e8742,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "address": "fa:16:3e:4a:0c:36", "network": {"id": "bf70d248-3de6-4375-85f0-c7b29d766fc1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1928035521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84123b277d334ce38d98292f7178eea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf8ff34-74", "ovs_interfaceid": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Converting VIF {"id": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "address": "fa:16:3e:4a:0c:36", "network": {"id": "bf70d248-3de6-4375-85f0-c7b29d766fc1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1928035521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84123b277d334ce38d98292f7178eea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf8ff34-74", "ovs_interfaceid": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=ebf8ff34-740f-4344-9caf-aec4d0b51afc,network=Network(bf70d248-3de6-4375-85f0-c7b29d766fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf8ff34-74') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG os_vif [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=ebf8ff34-740f-4344-9caf-aec4d0b51afc,network=Network(bf70d248-3de6-4375-85f0-c7b29d766fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf8ff34-74') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-41b9477a-5db6-4294-841b-c830fc808dbd req-0105d600-bfe0-4997-9404-4fca3d765b89 service nova] Releasing lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e63b133-0b0f-5081-8308-7ce493ca878e', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebf8ff34-74, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebf8ff34-74, col_values=(('qos', UUID('4ceeb26b-96a3-4881-8cf7-cdb08b39402c')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebf8ff34-74, col_values=(('external_ids', {'iface-id': 'ebf8ff34-740f-4344-9caf-aec4d0b51afc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:0c:36', 'vm-uuid': 'e00c5b4b-e155-4513-bda3-7eea536e8742'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:06 user nova-compute[75342]: INFO os_vif [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=ebf8ff34-740f-4344-9caf-aec4d0b51afc,network=Network(bf70d248-3de6-4375-85f0-c7b29d766fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf8ff34-74')
Nov 16 18:00:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] No BDM found with device name sda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:00:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:00:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] No VIF found with MAC fa:16:3e:4a:0c:36, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:00:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Using config drive
Nov 16 18:00:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:08 user nova-compute[75342]: DEBUG nova.network.neutron [req-557ebf21-6aab-481d-82ad-e9f0ec949bee req-6e86a7e5-7f94-4619-a70a-3198811298d8 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Updated VIF entry in instance network info cache for port ebf8ff34-740f-4344-9caf-aec4d0b51afc. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:08 user nova-compute[75342]: DEBUG nova.network.neutron [req-557ebf21-6aab-481d-82ad-e9f0ec949bee req-6e86a7e5-7f94-4619-a70a-3198811298d8 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Updating instance_info_cache with network_info: [{"id": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "address": "fa:16:3e:4a:0c:36", "network": {"id": "bf70d248-3de6-4375-85f0-c7b29d766fc1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1928035521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84123b277d334ce38d98292f7178eea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf8ff34-74", "ovs_interfaceid": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-557ebf21-6aab-481d-82ad-e9f0ec949bee req-6e86a7e5-7f94-4619-a70a-3198811298d8 service nova] Releasing lock "refresh_cache-e00c5b4b-e155-4513-bda3-7eea536e8742" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:08 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Creating config drive at /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk.config
Nov 16 18:00:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnnvz58lw {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnnvz58lw" returned: 0 in 0.108s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-23947ba2-919d-4a86-a387-41b5d56c2711 req-8f7e092c-a3d3-47cd-b234-e5684562b5bc service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Received event network-vif-plugged-ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-23947ba2-919d-4a86-a387-41b5d56c2711 req-8f7e092c-a3d3-47cd-b234-e5684562b5bc service nova] Acquiring lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-23947ba2-919d-4a86-a387-41b5d56c2711 req-8f7e092c-a3d3-47cd-b234-e5684562b5bc service nova] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-23947ba2-919d-4a86-a387-41b5d56c2711 req-8f7e092c-a3d3-47cd-b234-e5684562b5bc service nova] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-23947ba2-919d-4a86-a387-41b5d56c2711 req-8f7e092c-a3d3-47cd-b234-e5684562b5bc service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] No waiting events found dispatching network-vif-plugged-ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:10 user nova-compute[75342]: WARNING nova.compute.manager [req-23947ba2-919d-4a86-a387-41b5d56c2711 req-8f7e092c-a3d3-47cd-b234-e5684562b5bc service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Received unexpected event network-vif-plugged-ad751606-e2b6-4e87-8e84-b52e103606ad for instance with vm_state active and task_state None.
Nov 16 18:00:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:00:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Instance spawned successfully.
Nov 16 18:00:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:11 user nova-compute[75342]: INFO nova.compute.manager [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Took 13.07 seconds to spawn the instance on the hypervisor.
Nov 16 18:00:11 user nova-compute[75342]: DEBUG nova.compute.manager [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:00:11 user nova-compute[75342]: INFO nova.compute.manager [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Took 13.96 seconds to build instance.
Nov 16 18:00:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-52a4858c-61ba-4f8c-a721-be083b53a0ce tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.097s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:12 user nova-compute[75342]: DEBUG nova.compute.manager [req-163f44f5-4f00-4434-97ef-6432723df215 req-ce709ee3-24e3-4b8c-bc3e-3b4706dfa50a service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Received event network-vif-plugged-ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-163f44f5-4f00-4434-97ef-6432723df215 req-ce709ee3-24e3-4b8c-bc3e-3b4706dfa50a service nova] Acquiring lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-163f44f5-4f00-4434-97ef-6432723df215 req-ce709ee3-24e3-4b8c-bc3e-3b4706dfa50a service nova] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-163f44f5-4f00-4434-97ef-6432723df215 req-ce709ee3-24e3-4b8c-bc3e-3b4706dfa50a service nova] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:12 user nova-compute[75342]: DEBUG nova.compute.manager [req-163f44f5-4f00-4434-97ef-6432723df215 req-ce709ee3-24e3-4b8c-bc3e-3b4706dfa50a service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] No waiting events found dispatching network-vif-plugged-ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:12 user nova-compute[75342]: WARNING nova.compute.manager [req-163f44f5-4f00-4434-97ef-6432723df215 req-ce709ee3-24e3-4b8c-bc3e-3b4706dfa50a service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Received unexpected event network-vif-plugged-ad751606-e2b6-4e87-8e84-b52e103606ad for instance with vm_state active and task_state None.
Nov 16 18:00:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:13 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:00:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:13 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:00:13 user nova-compute[75342]: INFO nova.compute.claims [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Claim successful on node user
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:00:14 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Instance spawned successfully.
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.770s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:00:14 user nova-compute[75342]: INFO nova.compute.manager [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Took 11.39 seconds to spawn the instance on the hypervisor.
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:00:14 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:00:14 user nova-compute[75342]: INFO nova.compute.manager [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Took 13.33 seconds to build instance.
Nov 16 18:00:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1127932a-3238-44ed-a00b-e8a6859b5d93 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.883s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.policy [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca2efbe29024457cb872f32e561f0a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea851a0954345a0b6a29f5fa178f476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:00:14 user nova-compute[75342]: INFO nova.virt.block_device [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Booting with volume e99588c0-6d23-4cdf-b077-4d9d23522cea at /dev/vda
Nov 16 18:00:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:14 user nova-compute[75342]: DEBUG os_brick.utils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:14 user nova-compute[75342]: INFO oslo.privsep.daemon [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpeqqab7bd/privsep.sock']
Nov 16 18:00:14 user sudo[85563]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpeqqab7bd/privsep.sock
Nov 16 18:00:14 user sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 18:00:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:00:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:00:15 user nova-compute[75342]: INFO nova.compute.claims [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Claim successful on node user
Nov 16 18:00:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-74ce37c9-eba1-4009-864e-f9f12523db3c req-d7e6e625-3951-436e-8734-764631960725 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Received event network-vif-plugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-74ce37c9-eba1-4009-864e-f9f12523db3c req-d7e6e625-3951-436e-8734-764631960725 service nova] Acquiring lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-74ce37c9-eba1-4009-864e-f9f12523db3c req-d7e6e625-3951-436e-8734-764631960725 service nova] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-74ce37c9-eba1-4009-864e-f9f12523db3c req-d7e6e625-3951-436e-8734-764631960725 service nova] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-74ce37c9-eba1-4009-864e-f9f12523db3c req-d7e6e625-3951-436e-8734-764631960725 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] No waiting events found dispatching network-vif-plugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:15 user nova-compute[75342]: WARNING nova.compute.manager [req-74ce37c9-eba1-4009-864e-f9f12523db3c req-d7e6e625-3951-436e-8734-764631960725 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Received unexpected event network-vif-plugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 for instance with vm_state active and task_state None.
Nov 16 18:00:16 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.046s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Successfully created port: 90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:00:16 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:00:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG nova.policy [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb168b1c44c74c4a944a2a442fddd02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814d89f59bb949e7ad42a2d17774868c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:00:16 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Creating image(s)
Nov 16 18:00:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "/opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "/opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "/opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.386s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.018s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Acquiring lock "d057c823-fd25-45f9-ba3e-11a784f38064" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "d057c823-fd25-45f9-ba3e-11a784f38064" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.213s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Successfully updated port: 90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk 1073741824" returned: 0 in 0.156s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "refresh_cache-a04eb165-88b6-4826-a4ac-c1bc51a57ba5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquired lock "refresh_cache-a04eb165-88b6-4826-a4ac-c1bc51a57ba5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-40ee88c3-c46b-4e43-98dd-9e12c4a9d2cb req-0895ce03-0f34-4560-9858-f8fde2b88a78 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received event network-changed-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-40ee88c3-c46b-4e43-98dd-9e12c4a9d2cb req-0895ce03-0f34-4560-9858-f8fde2b88a78 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Refreshing instance network info cache due to event network-changed-90e051e5-17e8-4b97-92c4-2bd190722aa7. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-40ee88c3-c46b-4e43-98dd-9e12c4a9d2cb req-0895ce03-0f34-4560-9858-f8fde2b88a78 service nova] Acquiring lock "refresh_cache-a04eb165-88b6-4826-a4ac-c1bc51a57ba5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:00:17 user sudo[85563]: pam_unix(sudo:session): session closed for user root
Nov 16 18:00:17 user nova-compute[75342]: INFO nova.compute.claims [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Claim successful on node user
Nov 16 18:00:17 user nova-compute[75342]: INFO oslo.privsep.daemon [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Spawned new privsep daemon via rootwrap
Nov 16 18:00:17 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 18:00:17 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 18:00:17 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 16 18:00:17 user nova-compute[75342]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85570
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Successfully created port: 5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac07baf-a6a5-47b7-a857-a562eca0546a]: (2,) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Received event network-vif-plugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] Acquiring lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] No waiting events found dispatching network-vif-plugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:17 user nova-compute[75342]: WARNING nova.compute.manager [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Received unexpected event network-vif-plugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 for instance with vm_state active and task_state None.
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Received event network-vif-plugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] Acquiring lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] No waiting events found dispatching network-vif-plugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:17 user nova-compute[75342]: WARNING nova.compute.manager [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Received unexpected event network-vif-plugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc for instance with vm_state active and task_state None.
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Received event network-vif-plugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] Acquiring lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] No waiting events found dispatching network-vif-plugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:17 user nova-compute[75342]: WARNING nova.compute.manager [req-fca373e0-2a2a-4f85-87f1-38fd0539476a req-589611d2-1a33-4688-8e60-35fcec73f638 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Received unexpected event network-vif-plugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc for instance with vm_state active and task_state None.
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.296s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.066s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6fcb6b-645d-476e-b649-0907079b44dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:18 user nova-compute[75342]: WARNING os_brick.initiator.connectors.nvmeof [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Cannot resize image /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Ensure instance console log exists: /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.040s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a30a98-ed2a-4c39-8239-c1e56539131d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb3221e-6bdf-49a7-badd-e8bf8c80d306]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dc93d7-1ebe-467c-9920-57e64a204509]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:18 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0240d059-7c32-41cb-ba3b-e8031be36df8]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG os_brick.utils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] <== get_connector_properties: return (3438ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Updating existing volume attachment record: 53402a8d-03c0-469b-aaab-e259c99be4dc {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Updating instance_info_cache with network_info: [{"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Releasing lock "refresh_cache-a04eb165-88b6-4826-a4ac-c1bc51a57ba5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Instance network_info: |[{"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-40ee88c3-c46b-4e43-98dd-9e12c4a9d2cb req-0895ce03-0f34-4560-9858-f8fde2b88a78 service nova] Acquired lock "refresh_cache-a04eb165-88b6-4826-a4ac-c1bc51a57ba5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG nova.network.neutron [req-40ee88c3-c46b-4e43-98dd-9e12c4a9d2cb req-0895ce03-0f34-4560-9858-f8fde2b88a78 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Refreshing network info cache for port 90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:00:18 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Successfully updated port: 5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.428s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.172s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:00:19 user nova-compute[75342]: INFO nova.compute.claims [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Claim successful on node user
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "refresh_cache-07c92356-fdd3-4884-b406-55c92c63db18" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquired lock "refresh_cache-07c92356-fdd3-4884-b406-55c92c63db18" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-ce380f23-bd59-40a4-a4b9-bf19237aece6 req-b32d33db-13d3-49a4-b336-73cd7654114d service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-changed-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-ce380f23-bd59-40a4-a4b9-bf19237aece6 req-b32d33db-13d3-49a4-b336-73cd7654114d service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Refreshing instance network info cache due to event network-changed-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ce380f23-bd59-40a4-a4b9-bf19237aece6 req-b32d33db-13d3-49a4-b336-73cd7654114d service nova] Acquiring lock "refresh_cache-07c92356-fdd3-4884-b406-55c92c63db18" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.neutron [req-40ee88c3-c46b-4e43-98dd-9e12c4a9d2cb req-0895ce03-0f34-4560-9858-f8fde2b88a78 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Updated VIF entry in instance network info cache for port 90e051e5-17e8-4b97-92c4-2bd190722aa7. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.neutron [req-40ee88c3-c46b-4e43-98dd-9e12c4a9d2cb req-0895ce03-0f34-4560-9858-f8fde2b88a78 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Updating instance_info_cache with network_info: [{"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:00:19 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-40ee88c3-c46b-4e43-98dd-9e12c4a9d2cb req-0895ce03-0f34-4560-9858-f8fde2b88a78 service nova] Releasing lock "refresh_cache-a04eb165-88b6-4826-a4ac-c1bc51a57ba5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.policy [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff61915f003d41a4828ba719c2cfd0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4063aba08ce4f1d9c22413cc4ac2775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:00:19 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Creating image(s)
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Updating instance_info_cache with network_info: [{"id": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "address": "fa:16:3e:a2:09:b8", "network": {"id": "1581948e-40b3-4da2-8d21-7884b3e60f82", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2010698692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "814d89f59bb949e7ad42a2d17774868c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d8866e3-1d", "ovs_interfaceid": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Releasing lock "refresh_cache-07c92356-fdd3-4884-b406-55c92c63db18" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Instance network_info: |[{"id": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "address": "fa:16:3e:a2:09:b8", "network": {"id": "1581948e-40b3-4da2-8d21-7884b3e60f82", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2010698692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "814d89f59bb949e7ad42a2d17774868c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d8866e3-1d", "ovs_interfaceid": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ce380f23-bd59-40a4-a4b9-bf19237aece6 req-b32d33db-13d3-49a4-b336-73cd7654114d service nova] Acquired lock "refresh_cache-07c92356-fdd3-4884-b406-55c92c63db18" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.neutron [req-ce380f23-bd59-40a4-a4b9-bf19237aece6 req-b32d33db-13d3-49a4-b336-73cd7654114d service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Refreshing network info cache for port 5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Start _get_guest_xml network_info=[{"id": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "address": "fa:16:3e:a2:09:b8", "network": {"id": "1581948e-40b3-4da2-8d21-7884b3e60f82", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2010698692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "814d89f59bb949e7ad42a2d17774868c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d8866e3-1d", "ovs_interfaceid": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:00:19 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:19 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1175682526',display_name='tempest-TestVolumeSwap-server-1175682526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1175682526',id=8,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBURat+3hMRexJu9i4RhQh3IfN89dWyr95NKfnV7lN2vJH2ONnSJntUmX9bOtwpJuzgd282k9RiVpfSqTBFpIqNwghB0U5S/8IkU8GdG9dCd5kVoeq3cbxG6GOA54SE7nw==',key_name='tempest-keypair-1553058022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='814d89f59bb949e7ad42a2d17774868c',ramdisk_id='',reservation_id='r-u0wixwti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-397535750',owner_user_name='tempest-TestVolumeSwap-397535750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb168b1c44c74c4a944a2a442fddd02f',uuid=07c92356-fdd3-4884-b406-55c92c63db18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "address": "fa:16:3e:a2:09:b8", "network": {"id": "1581948e-40b3-4da2-8d21-7884b3e60f82", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2010698692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "814d89f59bb949e7ad42a2d17774868c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d8866e3-1d", "ovs_interfaceid": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Converting VIF {"id": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "address": "fa:16:3e:a2:09:b8", "network": {"id": "1581948e-40b3-4da2-8d21-7884b3e60f82", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2010698692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "814d89f59bb949e7ad42a2d17774868c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d8866e3-1d", "ovs_interfaceid": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:09:b8,bridge_name='br-int',has_traffic_filtering=True,id=5d8866e3-1d92-45b7-bdb9-aa00d8a6e402,network=Network(1581948e-40b3-4da2-8d21-7884b3e60f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d8866e3-1d') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.objects.instance [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lazy-loading 'pci_devices' on Instance uuid 07c92356-fdd3-4884-b406-55c92c63db18 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.294s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:00:19 user nova-compute[75342]:   <uuid>07c92356-fdd3-4884-b406-55c92c63db18</uuid>
Nov 16 18:00:19 user nova-compute[75342]:   <name>instance-00000008</name>
Nov 16 18:00:19 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:00:19 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:00:19 user nova-compute[75342]:   <metadata>
Nov 16 18:00:19 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:00:19 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:00:19 user nova-compute[75342]:       <nova:name>tempest-TestVolumeSwap-server-1175682526</nova:name>
Nov 16 18:00:19 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:00:19</nova:creationTime>
Nov 16 18:00:19 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:00:19 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:00:19 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:00:19 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:00:19 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:00:19 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:00:19 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:00:19 user nova-compute[75342]:       <nova:owner>
Nov 16 18:00:19 user nova-compute[75342]:         <nova:user uuid="cb168b1c44c74c4a944a2a442fddd02f">tempest-TestVolumeSwap-397535750-project-member</nova:user>
Nov 16 18:00:19 user nova-compute[75342]:         <nova:project uuid="814d89f59bb949e7ad42a2d17774868c">tempest-TestVolumeSwap-397535750</nova:project>
Nov 16 18:00:19 user nova-compute[75342]:       </nova:owner>
Nov 16 18:00:19 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:00:19 user nova-compute[75342]:       <nova:ports>
Nov 16 18:00:19 user nova-compute[75342]:         <nova:port uuid="5d8866e3-1d92-45b7-bdb9-aa00d8a6e402">
Nov 16 18:00:19 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 18:00:19 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:19 user nova-compute[75342]:       </nova:ports>
Nov 16 18:00:19 user nova-compute[75342]:     </nova:instance>
Nov 16 18:00:19 user nova-compute[75342]:   </metadata>
Nov 16 18:00:19 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:00:19 user nova-compute[75342]:     <system>
Nov 16 18:00:19 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:00:19 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:00:19 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:00:19 user nova-compute[75342]:       <entry name="serial">07c92356-fdd3-4884-b406-55c92c63db18</entry>
Nov 16 18:00:19 user nova-compute[75342]:       <entry name="uuid">07c92356-fdd3-4884-b406-55c92c63db18</entry>
Nov 16 18:00:19 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:00:19 user nova-compute[75342]:     </system>
Nov 16 18:00:19 user nova-compute[75342]:   </sysinfo>
Nov 16 18:00:19 user nova-compute[75342]:   <os>
Nov 16 18:00:19 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:00:19 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:00:19 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:00:19 user nova-compute[75342]:   </os>
Nov 16 18:00:19 user nova-compute[75342]:   <features>
Nov 16 18:00:19 user nova-compute[75342]:     <acpi/>
Nov 16 18:00:19 user nova-compute[75342]:     <apic/>
Nov 16 18:00:19 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:00:19 user nova-compute[75342]:   </features>
Nov 16 18:00:19 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:00:19 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:00:19 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:00:19 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:00:19 user nova-compute[75342]:   </clock>
Nov 16 18:00:19 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:00:19 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:00:19 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:00:19 user nova-compute[75342]:   </cpu>
Nov 16 18:00:19 user nova-compute[75342]:   <devices>
Nov 16 18:00:19 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:00:19 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:00:19 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk"/>
Nov 16 18:00:19 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:00:19 user nova-compute[75342]:     </disk>
Nov 16 18:00:19 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:19 user nova-compute[75342]:       <mac address="fa:16:3e:a2:09:b8"/>
Nov 16 18:00:19 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:19 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:19 user nova-compute[75342]:       <target dev="tap5d8866e3-1d"/>
Nov 16 18:00:19 user nova-compute[75342]:     </interface>
Nov 16 18:00:19 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:00:19 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/console.log" append="off"/>
Nov 16 18:00:19 user nova-compute[75342]:     </serial>
Nov 16 18:00:19 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:00:19 user nova-compute[75342]:     <video>
Nov 16 18:00:19 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:19 user nova-compute[75342]:     </video>
Nov 16 18:00:19 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:00:19 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:00:19 user nova-compute[75342]:     </rng>
Nov 16 18:00:19 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:00:19 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:00:19 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:00:19 user nova-compute[75342]:     </memballoon>
Nov 16 18:00:19 user nova-compute[75342]:   </devices>
Nov 16 18:00:19 user nova-compute[75342]: </domain>
Nov 16 18:00:19 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1175682526',display_name='tempest-TestVolumeSwap-server-1175682526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1175682526',id=8,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBURat+3hMRexJu9i4RhQh3IfN89dWyr95NKfnV7lN2vJH2ONnSJntUmX9bOtwpJuzgd282k9RiVpfSqTBFpIqNwghB0U5S/8IkU8GdG9dCd5kVoeq3cbxG6GOA54SE7nw==',key_name='tempest-keypair-1553058022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='814d89f59bb949e7ad42a2d17774868c',ramdisk_id='',reservation_id='r-u0wixwti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-397535750',owner_user_name='tempest-TestVolumeSwap-397535750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb168b1c44c74c4a944a2a442fddd02f',uuid=07c92356-fdd3-4884-b406-55c92c63db18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "address": "fa:16:3e:a2:09:b8", "network": {"id": "1581948e-40b3-4da2-8d21-7884b3e60f82", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2010698692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "814d89f59bb949e7ad42a2d17774868c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d8866e3-1d", "ovs_interfaceid": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Converting VIF {"id": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "address": "fa:16:3e:a2:09:b8", "network": {"id": "1581948e-40b3-4da2-8d21-7884b3e60f82", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2010698692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "814d89f59bb949e7ad42a2d17774868c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d8866e3-1d", "ovs_interfaceid": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:09:b8,bridge_name='br-int',has_traffic_filtering=True,id=5d8866e3-1d92-45b7-bdb9-aa00d8a6e402,network=Network(1581948e-40b3-4da2-8d21-7884b3e60f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d8866e3-1d') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG os_vif [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:09:b8,bridge_name='br-int',has_traffic_filtering=True,id=5d8866e3-1d92-45b7-bdb9-aa00d8a6e402,network=Network(1581948e-40b3-4da2-8d21-7884b3e60f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d8866e3-1d') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c124546b-e242-5364-987a-c9ed824d870c', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d8866e3-1d, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d8866e3-1d, col_values=(('qos', UUID('297e2ed7-6f6b-45e8-9589-00016019b556')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d8866e3-1d, col_values=(('external_ids', {'iface-id': '5d8866e3-1d92-45b7-bdb9-aa00d8a6e402', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:09:b8', 'vm-uuid': '07c92356-fdd3-4884-b406-55c92c63db18'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.217s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:20 user nova-compute[75342]: INFO os_vif [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:09:b8,bridge_name='br-int',has_traffic_filtering=True,id=5d8866e3-1d92-45b7-bdb9-aa00d8a6e402,network=Network(1581948e-40b3-4da2-8d21-7884b3e60f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d8866e3-1d')
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.165s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk 1073741824" returned: 0 in 0.150s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Successfully created port: f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] No VIF found with MAC fa:16:3e:a2:09:b8, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:00:20 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.213s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.policy [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd04c2b3446604237b5a0c18092043d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c15cbe30d84c4aade9097427271d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.network.neutron [req-ce380f23-bd59-40a4-a4b9-bf19237aece6 req-b32d33db-13d3-49a4-b336-73cd7654114d service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Updated VIF entry in instance network info cache for port 5d8866e3-1d92-45b7-bdb9-aa00d8a6e402. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.network.neutron [req-ce380f23-bd59-40a4-a4b9-bf19237aece6 req-b32d33db-13d3-49a4-b336-73cd7654114d service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Updating instance_info_cache with network_info: [{"id": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "address": "fa:16:3e:a2:09:b8", "network": {"id": "1581948e-40b3-4da2-8d21-7884b3e60f82", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2010698692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "814d89f59bb949e7ad42a2d17774868c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d8866e3-1d", "ovs_interfaceid": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ce380f23-bd59-40a4-a4b9-bf19237aece6 req-b32d33db-13d3-49a4-b336-73cd7654114d service nova] Releasing lock "refresh_cache-07c92356-fdd3-4884-b406-55c92c63db18" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:00:20 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Creating image(s)
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Acquiring lock "/opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "/opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "/opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Cannot resize image /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Ensure instance console log exists: /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.265s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.195s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk 1073741824" returned: 0 in 0.063s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.251s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Cannot resize image /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Ensure instance console log exists: /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Successfully updated port: f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquired lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-d4ea7c68-62a6-4903-9cb1-9b7e94ce9d51 req-8d042595-4134-4b0e-86ab-bc77f0f18961 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-changed-f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-d4ea7c68-62a6-4903-9cb1-9b7e94ce9d51 req-8d042595-4134-4b0e-86ab-bc77f0f18961 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Refreshing instance network info cache due to event network-changed-f1d3a970-40d8-420b-b632-c0231545cd41. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d4ea7c68-62a6-4903-9cb1-9b7e94ce9d51 req-8d042595-4134-4b0e-86ab-bc77f0f18961 service nova] Acquiring lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG nova.network.neutron [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Successfully created port: 201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.network.neutron [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Updating instance_info_cache with network_info: [{"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Releasing lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Instance network_info: |[{"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d4ea7c68-62a6-4903-9cb1-9b7e94ce9d51 req-8d042595-4134-4b0e-86ab-bc77f0f18961 service nova] Acquired lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.network.neutron [req-d4ea7c68-62a6-4903-9cb1-9b7e94ce9d51 req-8d042595-4134-4b0e-86ab-bc77f0f18961 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Refreshing network info cache for port f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Start _get_guest_xml network_info=[{"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:00:22 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:22 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1632151976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1632151976',id=9,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzlRPxa4PAPm45PMmq6l0+fBK9hV73ZL6geqM+y/RLFGg/C77lh7irpPP6ckBjAuzTfCveRgeMZjCC7DsaDkkVKcV+qSujYvT8RzL81EPVckf4RjSVpsZxqrwxx8lsoJw==',key_name='tempest-keypair-1617085374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4063aba08ce4f1d9c22413cc4ac2775',ramdisk_id='',reservation_id='r-ilc0wgmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1574754300',owner_user_name='tempest-TaggedAttachmentsTest-1574754300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61915f003d41a4828ba719c2cfd0a2',uuid=65e77fb1-8148-46a5-bc53-139b7ea096ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converting VIF {"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:51:1f,bridge_name='br-int',has_traffic_filtering=True,id=f1d3a970-40d8-420b-b632-c0231545cd41,network=Network(d47cc6c9-d413-44b3-9720-fe031f9a1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d3a970-40') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.objects.instance [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lazy-loading 'pci_devices' on Instance uuid 65e77fb1-8148-46a5-bc53-139b7ea096ad {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:00:22 user nova-compute[75342]:   <uuid>65e77fb1-8148-46a5-bc53-139b7ea096ad</uuid>
Nov 16 18:00:22 user nova-compute[75342]:   <name>instance-00000009</name>
Nov 16 18:00:22 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:00:22 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:00:22 user nova-compute[75342]:   <metadata>
Nov 16 18:00:22 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:00:22 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:00:22 user nova-compute[75342]:       <nova:name>tempest-device-tagging-server-1632151976</nova:name>
Nov 16 18:00:22 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:00:22</nova:creationTime>
Nov 16 18:00:22 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:00:22 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:00:22 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:00:22 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:00:22 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:00:22 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:00:22 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:00:22 user nova-compute[75342]:       <nova:owner>
Nov 16 18:00:22 user nova-compute[75342]:         <nova:user uuid="ff61915f003d41a4828ba719c2cfd0a2">tempest-TaggedAttachmentsTest-1574754300-project-member</nova:user>
Nov 16 18:00:22 user nova-compute[75342]:         <nova:project uuid="a4063aba08ce4f1d9c22413cc4ac2775">tempest-TaggedAttachmentsTest-1574754300</nova:project>
Nov 16 18:00:22 user nova-compute[75342]:       </nova:owner>
Nov 16 18:00:22 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:00:22 user nova-compute[75342]:       <nova:ports>
Nov 16 18:00:22 user nova-compute[75342]:         <nova:port uuid="f1d3a970-40d8-420b-b632-c0231545cd41">
Nov 16 18:00:22 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 18:00:22 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:22 user nova-compute[75342]:       </nova:ports>
Nov 16 18:00:22 user nova-compute[75342]:     </nova:instance>
Nov 16 18:00:22 user nova-compute[75342]:   </metadata>
Nov 16 18:00:22 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:00:22 user nova-compute[75342]:     <system>
Nov 16 18:00:22 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:00:22 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:00:22 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:00:22 user nova-compute[75342]:       <entry name="serial">65e77fb1-8148-46a5-bc53-139b7ea096ad</entry>
Nov 16 18:00:22 user nova-compute[75342]:       <entry name="uuid">65e77fb1-8148-46a5-bc53-139b7ea096ad</entry>
Nov 16 18:00:22 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:00:22 user nova-compute[75342]:     </system>
Nov 16 18:00:22 user nova-compute[75342]:   </sysinfo>
Nov 16 18:00:22 user nova-compute[75342]:   <os>
Nov 16 18:00:22 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:00:22 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:00:22 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:00:22 user nova-compute[75342]:   </os>
Nov 16 18:00:22 user nova-compute[75342]:   <features>
Nov 16 18:00:22 user nova-compute[75342]:     <acpi/>
Nov 16 18:00:22 user nova-compute[75342]:     <apic/>
Nov 16 18:00:22 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:00:22 user nova-compute[75342]:   </features>
Nov 16 18:00:22 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:00:22 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:00:22 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:00:22 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:00:22 user nova-compute[75342]:   </clock>
Nov 16 18:00:22 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:00:22 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:00:22 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:00:22 user nova-compute[75342]:   </cpu>
Nov 16 18:00:22 user nova-compute[75342]:   <devices>
Nov 16 18:00:22 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:00:22 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:00:22 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk"/>
Nov 16 18:00:22 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:00:22 user nova-compute[75342]:     </disk>
Nov 16 18:00:22 user nova-compute[75342]:     <disk type="file" device="cdrom">
Nov 16 18:00:22 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 18:00:22 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk.config"/>
Nov 16 18:00:22 user nova-compute[75342]:       <target dev="hda" bus="ide"/>
Nov 16 18:00:22 user nova-compute[75342]:     </disk>
Nov 16 18:00:22 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:22 user nova-compute[75342]:       <mac address="fa:16:3e:c1:51:1f"/>
Nov 16 18:00:22 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:22 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:22 user nova-compute[75342]:       <target dev="tapf1d3a970-40"/>
Nov 16 18:00:22 user nova-compute[75342]:     </interface>
Nov 16 18:00:22 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:00:22 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/console.log" append="off"/>
Nov 16 18:00:22 user nova-compute[75342]:     </serial>
Nov 16 18:00:22 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:00:22 user nova-compute[75342]:     <video>
Nov 16 18:00:22 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:22 user nova-compute[75342]:     </video>
Nov 16 18:00:22 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:00:22 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:00:22 user nova-compute[75342]:     </rng>
Nov 16 18:00:22 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:00:22 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:00:22 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:00:22 user nova-compute[75342]:     </memballoon>
Nov 16 18:00:22 user nova-compute[75342]:   </devices>
Nov 16 18:00:22 user nova-compute[75342]: </domain>
Nov 16 18:00:22 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1632151976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1632151976',id=9,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzlRPxa4PAPm45PMmq6l0+fBK9hV73ZL6geqM+y/RLFGg/C77lh7irpPP6ckBjAuzTfCveRgeMZjCC7DsaDkkVKcV+qSujYvT8RzL81EPVckf4RjSVpsZxqrwxx8lsoJw==',key_name='tempest-keypair-1617085374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4063aba08ce4f1d9c22413cc4ac2775',ramdisk_id='',reservation_id='r-ilc0wgmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1574754300',owner_user_name='tempest-TaggedAttachmentsTest-1574754300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61915f003d41a4828ba719c2cfd0a2',uuid=65e77fb1-8148-46a5-bc53-139b7ea096ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converting VIF {"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:51:1f,bridge_name='br-int',has_traffic_filtering=True,id=f1d3a970-40d8-420b-b632-c0231545cd41,network=Network(d47cc6c9-d413-44b3-9720-fe031f9a1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d3a970-40') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG os_vif [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:51:1f,bridge_name='br-int',has_traffic_filtering=True,id=f1d3a970-40d8-420b-b632-c0231545cd41,network=Network(d47cc6c9-d413-44b3-9720-fe031f9a1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d3a970-40') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af04f01d-2f98-5bf5-a806-b83e2818244e', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1d3a970-40, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1d3a970-40, col_values=(('qos', UUID('8d7952ec-dbce-49ef-8047-d9e3c545eb1c')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1d3a970-40, col_values=(('external_ids', {'iface-id': 'f1d3a970-40d8-420b-b632-c0231545cd41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:51:1f', 'vm-uuid': '65e77fb1-8148-46a5-bc53-139b7ea096ad'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:22 user nova-compute[75342]: INFO os_vif [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:51:1f,bridge_name='br-int',has_traffic_filtering=True,id=f1d3a970-40d8-420b-b632-c0231545cd41,network=Network(d47cc6c9-d413-44b3-9720-fe031f9a1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d3a970-40')
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] No BDM found with device name hda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:00:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] No VIF found with MAC fa:16:3e:c1:51:1f, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:00:22 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Using config drive
Nov 16 18:00:23 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Creating config drive at /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk.config
Nov 16 18:00:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfdc6kgwk {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfdc6kgwk" returned: 0 in 0.080s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.network.neutron [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Successfully updated port: 201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.network.neutron [req-d4ea7c68-62a6-4903-9cb1-9b7e94ce9d51 req-8d042595-4134-4b0e-86ab-bc77f0f18961 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Updated VIF entry in instance network info cache for port f1d3a970-40d8-420b-b632-c0231545cd41. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.network.neutron [req-d4ea7c68-62a6-4903-9cb1-9b7e94ce9d51 req-8d042595-4134-4b0e-86ab-bc77f0f18961 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Updating instance_info_cache with network_info: [{"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Acquiring lock "refresh_cache-d057c823-fd25-45f9-ba3e-11a784f38064" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Acquired lock "refresh_cache-d057c823-fd25-45f9-ba3e-11a784f38064" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.network.neutron [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d4ea7c68-62a6-4903-9cb1-9b7e94ce9d51 req-8d042595-4134-4b0e-86ab-bc77f0f18961 service nova] Releasing lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.network.neutron [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.network.neutron [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Updating instance_info_cache with network_info: [{"id": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "address": "fa:16:3e:71:76:9d", "network": {"id": "d84baa34-4221-483e-9b50-d08061b235a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-733195092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7c15cbe30d84c4aade9097427271d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201ad806-d2", "ovs_interfaceid": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Releasing lock "refresh_cache-d057c823-fd25-45f9-ba3e-11a784f38064" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.compute.manager [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Instance network_info: |[{"id": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "address": "fa:16:3e:71:76:9d", "network": {"id": "d84baa34-4221-483e-9b50-d08061b235a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-733195092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7c15cbe30d84c4aade9097427271d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201ad806-d2", "ovs_interfaceid": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Start _get_guest_xml network_info=[{"id": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "address": "fa:16:3e:71:76:9d", "network": {"id": "d84baa34-4221-483e-9b50-d08061b235a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-733195092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7c15cbe30d84c4aade9097427271d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201ad806-d2", "ovs_interfaceid": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:00:23 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:23 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:00:23 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1293732500',display_name='tempest-VolumesAssistedSnapshotsTest-server-1293732500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1293732500',id=10,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETYGuphuHkflov/skUKewUKhVjUwvjV3Z/bWKfbCBFqBQiKlLk0LGivtsluo+tUOUn4g3xiQa00KVLKT2zoyR7IWTCXjpupa+0hfUUhDfXvMwa4y17V0BOrnqX7PhK0zQ==',key_name='tempest-keypair-1327000719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7c15cbe30d84c4aade9097427271d20',ramdisk_id='',reservation_id='r-99i7ipsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-209870780',owner_user_name='tempest-VolumesAssistedSnapshotsTest-209870780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d04c2b3446604237b5a0c18092043d6d',uuid=d057c823-fd25-45f9-ba3e-11a784f38064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "address": "fa:16:3e:71:76:9d", "network": {"id": "d84baa34-4221-483e-9b50-d08061b235a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-733195092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7c15cbe30d84c4aade9097427271d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201ad806-d2", "ovs_interfaceid": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Converting VIF {"id": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "address": "fa:16:3e:71:76:9d", "network": {"id": "d84baa34-4221-483e-9b50-d08061b235a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-733195092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7c15cbe30d84c4aade9097427271d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201ad806-d2", "ovs_interfaceid": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:76:9d,bridge_name='br-int',has_traffic_filtering=True,id=201ad806-d285-4ca8-91f3-5df4ba73d7e4,network=Network(d84baa34-4221-483e-9b50-d08061b235a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201ad806-d2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.objects.instance [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lazy-loading 'pci_devices' on Instance uuid d057c823-fd25-45f9-ba3e-11a784f38064 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-a2b1eaa9-7e51-4bd1-b108-b098cc9b2cac req-28dd9d80-0b3e-4c2c-a1aa-82b10642d666 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Received event network-changed-201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-a2b1eaa9-7e51-4bd1-b108-b098cc9b2cac req-28dd9d80-0b3e-4c2c-a1aa-82b10642d666 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Refreshing instance network info cache due to event network-changed-201ad806-d285-4ca8-91f3-5df4ba73d7e4. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2b1eaa9-7e51-4bd1-b108-b098cc9b2cac req-28dd9d80-0b3e-4c2c-a1aa-82b10642d666 service nova] Acquiring lock "refresh_cache-d057c823-fd25-45f9-ba3e-11a784f38064" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2b1eaa9-7e51-4bd1-b108-b098cc9b2cac req-28dd9d80-0b3e-4c2c-a1aa-82b10642d666 service nova] Acquired lock "refresh_cache-d057c823-fd25-45f9-ba3e-11a784f38064" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.network.neutron [req-a2b1eaa9-7e51-4bd1-b108-b098cc9b2cac req-28dd9d80-0b3e-4c2c-a1aa-82b10642d666 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Refreshing network info cache for port 201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:00:24 user nova-compute[75342]:   <uuid>d057c823-fd25-45f9-ba3e-11a784f38064</uuid>
Nov 16 18:00:24 user nova-compute[75342]:   <name>instance-0000000a</name>
Nov 16 18:00:24 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:00:24 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:00:24 user nova-compute[75342]:   <metadata>
Nov 16 18:00:24 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:00:24 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:00:24 user nova-compute[75342]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1293732500</nova:name>
Nov 16 18:00:24 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:00:23</nova:creationTime>
Nov 16 18:00:24 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:00:24 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:00:24 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:00:24 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:00:24 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:00:24 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:00:24 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:00:24 user nova-compute[75342]:       <nova:owner>
Nov 16 18:00:24 user nova-compute[75342]:         <nova:user uuid="d04c2b3446604237b5a0c18092043d6d">tempest-VolumesAssistedSnapshotsTest-209870780-project-member</nova:user>
Nov 16 18:00:24 user nova-compute[75342]:         <nova:project uuid="e7c15cbe30d84c4aade9097427271d20">tempest-VolumesAssistedSnapshotsTest-209870780</nova:project>
Nov 16 18:00:24 user nova-compute[75342]:       </nova:owner>
Nov 16 18:00:24 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:00:24 user nova-compute[75342]:       <nova:ports>
Nov 16 18:00:24 user nova-compute[75342]:         <nova:port uuid="201ad806-d285-4ca8-91f3-5df4ba73d7e4">
Nov 16 18:00:24 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 18:00:24 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:24 user nova-compute[75342]:       </nova:ports>
Nov 16 18:00:24 user nova-compute[75342]:     </nova:instance>
Nov 16 18:00:24 user nova-compute[75342]:   </metadata>
Nov 16 18:00:24 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:00:24 user nova-compute[75342]:     <system>
Nov 16 18:00:24 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:00:24 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:00:24 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:00:24 user nova-compute[75342]:       <entry name="serial">d057c823-fd25-45f9-ba3e-11a784f38064</entry>
Nov 16 18:00:24 user nova-compute[75342]:       <entry name="uuid">d057c823-fd25-45f9-ba3e-11a784f38064</entry>
Nov 16 18:00:24 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:00:24 user nova-compute[75342]:     </system>
Nov 16 18:00:24 user nova-compute[75342]:   </sysinfo>
Nov 16 18:00:24 user nova-compute[75342]:   <os>
Nov 16 18:00:24 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:00:24 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:00:24 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:00:24 user nova-compute[75342]:   </os>
Nov 16 18:00:24 user nova-compute[75342]:   <features>
Nov 16 18:00:24 user nova-compute[75342]:     <acpi/>
Nov 16 18:00:24 user nova-compute[75342]:     <apic/>
Nov 16 18:00:24 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:00:24 user nova-compute[75342]:   </features>
Nov 16 18:00:24 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:00:24 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:00:24 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:00:24 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:00:24 user nova-compute[75342]:   </clock>
Nov 16 18:00:24 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:00:24 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:00:24 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:00:24 user nova-compute[75342]:   </cpu>
Nov 16 18:00:24 user nova-compute[75342]:   <devices>
Nov 16 18:00:24 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:00:24 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:00:24 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk"/>
Nov 16 18:00:24 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:00:24 user nova-compute[75342]:     </disk>
Nov 16 18:00:24 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:24 user nova-compute[75342]:       <mac address="fa:16:3e:71:76:9d"/>
Nov 16 18:00:24 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:24 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:24 user nova-compute[75342]:       <target dev="tap201ad806-d2"/>
Nov 16 18:00:24 user nova-compute[75342]:     </interface>
Nov 16 18:00:24 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:00:24 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/console.log" append="off"/>
Nov 16 18:00:24 user nova-compute[75342]:     </serial>
Nov 16 18:00:24 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:00:24 user nova-compute[75342]:     <video>
Nov 16 18:00:24 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:24 user nova-compute[75342]:     </video>
Nov 16 18:00:24 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:00:24 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:00:24 user nova-compute[75342]:     </rng>
Nov 16 18:00:24 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:00:24 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:00:24 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:00:24 user nova-compute[75342]:     </memballoon>
Nov 16 18:00:24 user nova-compute[75342]:   </devices>
Nov 16 18:00:24 user nova-compute[75342]: </domain>
Nov 16 18:00:24 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1293732500',display_name='tempest-VolumesAssistedSnapshotsTest-server-1293732500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1293732500',id=10,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETYGuphuHkflov/skUKewUKhVjUwvjV3Z/bWKfbCBFqBQiKlLk0LGivtsluo+tUOUn4g3xiQa00KVLKT2zoyR7IWTCXjpupa+0hfUUhDfXvMwa4y17V0BOrnqX7PhK0zQ==',key_name='tempest-keypair-1327000719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7c15cbe30d84c4aade9097427271d20',ramdisk_id='',reservation_id='r-99i7ipsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-209870780',owner_user_name='tempest-VolumesAssistedSnapshotsTest-209870780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d04c2b3446604237b5a0c18092043d6d',uuid=d057c823-fd25-45f9-ba3e-11a784f38064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "address": "fa:16:3e:71:76:9d", "network": {"id": "d84baa34-4221-483e-9b50-d08061b235a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-733195092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7c15cbe30d84c4aade9097427271d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201ad806-d2", "ovs_interfaceid": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Converting VIF {"id": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "address": "fa:16:3e:71:76:9d", "network": {"id": "d84baa34-4221-483e-9b50-d08061b235a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-733195092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7c15cbe30d84c4aade9097427271d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201ad806-d2", "ovs_interfaceid": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:76:9d,bridge_name='br-int',has_traffic_filtering=True,id=201ad806-d285-4ca8-91f3-5df4ba73d7e4,network=Network(d84baa34-4221-483e-9b50-d08061b235a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201ad806-d2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG os_vif [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:76:9d,bridge_name='br-int',has_traffic_filtering=True,id=201ad806-d285-4ca8-91f3-5df4ba73d7e4,network=Network(d84baa34-4221-483e-9b50-d08061b235a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201ad806-d2') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45ce3016-ffec-52ef-b5a2-065620a635b6', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap201ad806-d2, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap201ad806-d2, col_values=(('qos', UUID('1b54f810-f613-41af-8a1e-8cfd36e0dd94')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap201ad806-d2, col_values=(('external_ids', {'iface-id': '201ad806-d285-4ca8-91f3-5df4ba73d7e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:76:9d', 'vm-uuid': 'd057c823-fd25-45f9-ba3e-11a784f38064'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:24 user nova-compute[75342]: INFO os_vif [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:76:9d,bridge_name='br-int',has_traffic_filtering=True,id=201ad806-d285-4ca8-91f3-5df4ba73d7e4,network=Network(d84baa34-4221-483e-9b50-d08061b235a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201ad806-d2')
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] No VIF found with MAC fa:16:3e:71:76:9d, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:00:24 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Instance spawned successfully.
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:24 user nova-compute[75342]: INFO nova.compute.manager [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.network.neutron [req-a2b1eaa9-7e51-4bd1-b108-b098cc9b2cac req-28dd9d80-0b3e-4c2c-a1aa-82b10642d666 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Updated VIF entry in instance network info cache for port 201ad806-d285-4ca8-91f3-5df4ba73d7e4. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG nova.network.neutron [req-a2b1eaa9-7e51-4bd1-b108-b098cc9b2cac req-28dd9d80-0b3e-4c2c-a1aa-82b10642d666 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Updating instance_info_cache with network_info: [{"id": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "address": "fa:16:3e:71:76:9d", "network": {"id": "d84baa34-4221-483e-9b50-d08061b235a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-733195092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7c15cbe30d84c4aade9097427271d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201ad806-d2", "ovs_interfaceid": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:24 user nova-compute[75342]: INFO nova.compute.manager [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Took 9.58 seconds to build instance.
Nov 16 18:00:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2b1eaa9-7e51-4bd1-b108-b098cc9b2cac req-28dd9d80-0b3e-4c2c-a1aa-82b10642d666 service nova] Releasing lock "refresh_cache-d057c823-fd25-45f9-ba3e-11a784f38064" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98aa94cf-66ae-40d2-b42f-98ad41ab8ea2 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.042s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] There are 0 instances to clean {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:00:26 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Creating image(s)
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Ensure instance console log exists: /opt/stack/data/nova/instances/a04eb165-88b6-4826-a4ac-c1bc51a57ba5/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Start _get_guest_xml network_info=[{"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '53402a8d-03c0-469b-aaab-e259c99be4dc', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWYftGCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a04eb165-88b6-4826-a4ac-c1bc51a57ba5', 'attached_at': '', 'detached_at': '', 'volume_id': 'e99588c0-6d23-4cdf-b077-4d9d23522cea', 'serial': 'e99588c0-6d23-4cdf-b077-4d9d23522cea'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:00:26 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:26 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connector [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Factory for ISCSI on None {{(pid=75342) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWYftGCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:26 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.009s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:26 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:26 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0155c2a9-f14c-4b4f-8971-2f9d7b66b774]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:00:26 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.040s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97879438-2045-48a2-96ea-3c47b89cbdbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea] added
Nov 16 18:00:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f696fd-b848-46f6-868a-76584a9d82cc]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9058e273-d7f9-4bb2-bdd1-48fa3417832a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWYftGCr {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWYftGCr" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d7e2f-7315-49aa-bc52-3ddd66bc6d16]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PWYftGCr'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b271045-bec8-4250-9f76-c8c5ba723191]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0719d929-eef6-4b25-b0fb-b720c6d2e720]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:00:26 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:00:26 user nova-compute[75342]:  {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:26 user nova-compute[75342]: WARNING os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 18:00:26 user nova-compute[75342]: 
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a13a9a-54d4-4237-8ce8-78351023f25e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260]
Nov 16 18:00:26 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260] successful.
Nov 16 18:00:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3534c6-8776-4c84-bf3c-69653df8e445]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9e3598-bce2-45ba-9bbb-d5ee9923539a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a47e2d-be41-413e-a397-dafea0fe6587]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWYftGCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26663653135633035', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663653135633035', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1419826400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1419826400',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2YBWpL94rC07MMzLKaBsNk11Qeq2JUeq4m7GthUjfbOD5heJ9mYXBMqIg2uamJMvflvGY3eC+tTt19WLMkmpw0VhnB/T+nyASoArfoa2sGiszErzJ01aVT1fJwxYOKpw==',key_name='tempest-keypair-690867906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea851a0954345a0b6a29f5fa178f476',ramdisk_id='',reservation_id='r-utzjni68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-439717470',owner_user_name='tempest-ServerActionsV293TestJSON-439717470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2efbe29024457cb872f32e561f0a21',uuid=a04eb165-88b6-4826-a4ac-c1bc51a57ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converting VIF {"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG nova.objects.instance [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lazy-loading 'pci_devices' on Instance uuid a04eb165-88b6-4826-a4ac-c1bc51a57ba5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:00:27 user nova-compute[75342]:   <uuid>a04eb165-88b6-4826-a4ac-c1bc51a57ba5</uuid>
Nov 16 18:00:27 user nova-compute[75342]:   <name>instance-00000007</name>
Nov 16 18:00:27 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:00:27 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:00:27 user nova-compute[75342]:   <metadata>
Nov 16 18:00:27 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:00:27 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:00:27 user nova-compute[75342]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1419826400</nova:name>
Nov 16 18:00:27 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:00:26</nova:creationTime>
Nov 16 18:00:27 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:00:27 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:00:27 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:00:27 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:00:27 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:00:27 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:00:27 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:00:27 user nova-compute[75342]:       <nova:owner>
Nov 16 18:00:27 user nova-compute[75342]:         <nova:user uuid="ca2efbe29024457cb872f32e561f0a21">tempest-ServerActionsV293TestJSON-439717470-project-member</nova:user>
Nov 16 18:00:27 user nova-compute[75342]:         <nova:project uuid="fea851a0954345a0b6a29f5fa178f476">tempest-ServerActionsV293TestJSON-439717470</nova:project>
Nov 16 18:00:27 user nova-compute[75342]:       </nova:owner>
Nov 16 18:00:27 user nova-compute[75342]:       <nova:ports>
Nov 16 18:00:27 user nova-compute[75342]:         <nova:port uuid="90e051e5-17e8-4b97-92c4-2bd190722aa7">
Nov 16 18:00:27 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 18:00:27 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:27 user nova-compute[75342]:       </nova:ports>
Nov 16 18:00:27 user nova-compute[75342]:     </nova:instance>
Nov 16 18:00:27 user nova-compute[75342]:   </metadata>
Nov 16 18:00:27 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:00:27 user nova-compute[75342]:     <system>
Nov 16 18:00:27 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:00:27 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:00:27 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:00:27 user nova-compute[75342]:       <entry name="serial">a04eb165-88b6-4826-a4ac-c1bc51a57ba5</entry>
Nov 16 18:00:27 user nova-compute[75342]:       <entry name="uuid">a04eb165-88b6-4826-a4ac-c1bc51a57ba5</entry>
Nov 16 18:00:27 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:00:27 user nova-compute[75342]:     </system>
Nov 16 18:00:27 user nova-compute[75342]:   </sysinfo>
Nov 16 18:00:27 user nova-compute[75342]:   <os>
Nov 16 18:00:27 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:00:27 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:00:27 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:00:27 user nova-compute[75342]:   </os>
Nov 16 18:00:27 user nova-compute[75342]:   <features>
Nov 16 18:00:27 user nova-compute[75342]:     <acpi/>
Nov 16 18:00:27 user nova-compute[75342]:     <apic/>
Nov 16 18:00:27 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:00:27 user nova-compute[75342]:   </features>
Nov 16 18:00:27 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:00:27 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:00:27 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:00:27 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:00:27 user nova-compute[75342]:   </clock>
Nov 16 18:00:27 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:00:27 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:00:27 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:00:27 user nova-compute[75342]:   </cpu>
Nov 16 18:00:27 user nova-compute[75342]:   <devices>
Nov 16 18:00:27 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:00:27 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:00:27 user nova-compute[75342]:       <source dev="/dev/sdb"/>
Nov 16 18:00:27 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:00:27 user nova-compute[75342]:       <serial>e99588c0-6d23-4cdf-b077-4d9d23522cea</serial>
Nov 16 18:00:27 user nova-compute[75342]:     </disk>
Nov 16 18:00:27 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:27 user nova-compute[75342]:       <mac address="fa:16:3e:ff:fd:18"/>
Nov 16 18:00:27 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:27 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:27 user nova-compute[75342]:       <target dev="tap90e051e5-17"/>
Nov 16 18:00:27 user nova-compute[75342]:     </interface>
Nov 16 18:00:27 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:00:27 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/a04eb165-88b6-4826-a4ac-c1bc51a57ba5/console.log" append="off"/>
Nov 16 18:00:27 user nova-compute[75342]:     </serial>
Nov 16 18:00:27 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:00:27 user nova-compute[75342]:     <video>
Nov 16 18:00:27 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:27 user nova-compute[75342]:     </video>
Nov 16 18:00:27 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:00:27 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:00:27 user nova-compute[75342]:     </rng>
Nov 16 18:00:27 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:00:27 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:00:27 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:00:27 user nova-compute[75342]:     </memballoon>
Nov 16 18:00:27 user nova-compute[75342]:   </devices>
Nov 16 18:00:27 user nova-compute[75342]: </domain>
Nov 16 18:00:27 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1419826400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1419826400',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2YBWpL94rC07MMzLKaBsNk11Qeq2JUeq4m7GthUjfbOD5heJ9mYXBMqIg2uamJMvflvGY3eC+tTt19WLMkmpw0VhnB/T+nyASoArfoa2sGiszErzJ01aVT1fJwxYOKpw==',key_name='tempest-keypair-690867906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea851a0954345a0b6a29f5fa178f476',ramdisk_id='',reservation_id='r-utzjni68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-439717470',owner_user_name='tempest-ServerActionsV293TestJSON-439717470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2efbe29024457cb872f32e561f0a21',uuid=a04eb165-88b6-4826-a4ac-c1bc51a57ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converting VIF {"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG os_vif [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad9a6805-b516-57d8-bcb3-61ab930efe14', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90e051e5-17, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90e051e5-17, col_values=(('qos', UUID('66ea0cb6-01b7-4784-9368-72ba1ae599a5')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90e051e5-17, col_values=(('external_ids', {'iface-id': '90e051e5-17e8-4b97-92c4-2bd190722aa7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:fd:18', 'vm-uuid': 'a04eb165-88b6-4826-a4ac-c1bc51a57ba5'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:28 user nova-compute[75342]: INFO os_vif [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17')
Nov 16 18:00:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] No VIF found with MAC fa:16:3e:ff:fd:18, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:00:28 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Instance spawned successfully.
Nov 16 18:00:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:29 user nova-compute[75342]: DEBUG nova.compute.manager [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:00:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:00:29 user nova-compute[75342]: INFO nova.compute.manager [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Took 9.51 seconds to spawn the instance on the hypervisor.
Nov 16 18:00:29 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:00:29 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Instance spawned successfully.
Nov 16 18:00:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:00:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:29 user nova-compute[75342]: INFO nova.compute.manager [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Took 11.74 seconds to build instance.
Nov 16 18:00:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2d246daa-4fb1-4b8a-b1e8-3659e4a08193 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.053s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:29 user nova-compute[75342]: INFO nova.compute.manager [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Took 8.62 seconds to spawn the instance on the hypervisor.
Nov 16 18:00:29 user nova-compute[75342]: DEBUG nova.compute.manager [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:00:29 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:29 user nova-compute[75342]: INFO nova.compute.manager [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Took 11.72 seconds to build instance.
Nov 16 18:00:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fb9cf3c0-90d8-4413-a8cc-3ed11b5a1bca tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "d057c823-fd25-45f9-ba3e-11a784f38064" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.227s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:30 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:30 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:00:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:31 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:00:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:00:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Skipping network cache update for instance because it is Building. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 18:00:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:31 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:00:31 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 85cd3e12-187f-48ba-9753-e8e93787cdf4 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updating instance_info_cache with network_info: [{"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:00:32 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Instance spawned successfully.
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:32 user nova-compute[75342]: INFO nova.compute.manager [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 16 18:00:32 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:32 user nova-compute[75342]: INFO nova.compute.manager [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Took 19.62 seconds to build instance.
Nov 16 18:00:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce1cd5e5-17c8-4cc2-b464-372afdab2672 tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.837s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:34 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:00:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:00:34 user nova-compute[75342]: INFO nova.compute.claims [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Claim successful on node user
Nov 16 18:00:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json" returned: 0 in 0.346s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.096s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:00:35 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:00:35 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:00:35 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:00:36 user nova-compute[75342]: INFO nova.virt.block_device [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Booting with volume c7e2262c-ca41-489a-98f8-0bfd89ecbd19 at /dev/vda
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG nova.policy [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '276674d90afe48ca96935377dba663ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266d252d115e4d61b5c7830bc4c4b4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG os_brick.utils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[662cc458-3d74-4786-85d1-d97587897384]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5bcd2a-66a5-4099-9166-a1959642a8ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe20e60-c31f-4ac9-8f79-5736a1449264]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71e7ab8-eaa2-48e0-beb7-262bbfcd2670]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:36 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[04254c80-61a2-4222-89ea-c46eb11c202d]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG os_brick.utils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating existing volume attachment record: 036bbc74-ff0d-4e55-9688-430095a04ea7 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:37 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully created port: b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:37 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:00:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully created port: 0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:00:38 user nova-compute[75342]: INFO nova.compute.claims [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Claim successful on node user
Nov 16 18:00:38 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:38 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7477MB free_disk=25.64166259765625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Refreshing inventories for resource provider fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Updating ProviderTree inventory for provider fdd6b940-75a0-4315-8416-79157aaeea59 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Refreshing aggregate associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, aggregates: None {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Refreshing trait associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, traits: COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully created port: 525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.749s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.731s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:00:38 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:00:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 35052d56-cec1-4a07-84f4-a6f5b65bb9bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 2992b5fc-86e6-425f-82e5-cf6358582872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance e00c5b4b-e155-4513-bda3-7eea536e8742 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance a04eb165-88b6-4826-a4ac-c1bc51a57ba5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 07c92356-fdd3-4884-b406-55c92c63db18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 65e77fb1-8148-46a5-bc53-139b7ea096ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d057c823-fd25-45f9-ba3e-11a784f38064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 77a26e02-f97e-4911-9dd4-3f6f30d92edc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 89e3e5a3-2d3c-46d8-b155-3dc429531e00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:00:39 user nova-compute[75342]: INFO nova.virt.block_device [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Booting with volume 6ed6108f-8574-49bc-be9e-1ff3bcf1e56c at /dev/vda
Nov 16 18:00:39 user nova-compute[75342]: DEBUG os_brick.utils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.policy [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3904f422a1964577b7ffe40a188034b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5614cdd6149a472b93ac97406fa087ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde63ce2-cbb0-4840-94ed-a083911c88f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b55d4c-9dc3-49f8-856e-2ca63b90f18f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12f43dd-39fa-44d9-9766-0458dc67de5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f02450-10d0-41ad-87cf-6713bacbf730]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:39 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b48ac43-f01b-4989-bc79-50afb9c0f6f6]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG os_brick.utils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating existing volume attachment record: cb1cec4f-b273-4bfe-b3f2-5fbe829fbb04 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully created port: 76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.681s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:39 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:00:40 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully created port: ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:40 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully created port: 5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:41 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully created port: 7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully updated port: b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-b8108421-f4b3-4d03-98fe-2bb0d2a25daf req-8f1b45c7-10ab-4f98-a093-fbb801d00a0d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-changed-b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-b8108421-f4b3-4d03-98fe-2bb0d2a25daf req-8f1b45c7-10ab-4f98-a093-fbb801d00a0d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing instance network info cache due to event network-changed-b611b37d-a062-41de-9792-7a3c5c60cfc4. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b8108421-f4b3-4d03-98fe-2bb0d2a25daf req-8f1b45c7-10ab-4f98-a093-fbb801d00a0d service nova] Acquiring lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b8108421-f4b3-4d03-98fe-2bb0d2a25daf req-8f1b45c7-10ab-4f98-a093-fbb801d00a0d service nova] Acquired lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG nova.network.neutron [req-b8108421-f4b3-4d03-98fe-2bb0d2a25daf req-8f1b45c7-10ab-4f98-a093-fbb801d00a0d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing network info cache for port b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG nova.network.neutron [req-b8108421-f4b3-4d03-98fe-2bb0d2a25daf req-8f1b45c7-10ab-4f98-a093-fbb801d00a0d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:42 user nova-compute[75342]: INFO nova.virt.block_device [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Booting with volume 723ba8e7-ee09-4572-82e8-6933d6cee584 at /dev/vdb
Nov 16 18:00:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG os_brick.utils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a86a17-b68e-4ea6-a142-83035b18fd30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e94e22-1105-43bc-8df3-ba67c43d7863]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfc702f-9fc0-48b3-966a-1cd808056657]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9297f1-2103-41e6-9da4-70c307eccea7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:42 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8dc057-525a-478f-9ab2-b6b8a5089331]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG os_brick.utils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating existing volume attachment record: ed06ff9f-23f4-4fe8-9d43-1de36396c047 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG nova.network.neutron [req-b8108421-f4b3-4d03-98fe-2bb0d2a25daf req-8f1b45c7-10ab-4f98-a093-fbb801d00a0d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b8108421-f4b3-4d03-98fe-2bb0d2a25daf req-8f1b45c7-10ab-4f98-a093-fbb801d00a0d service nova] Releasing lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:42 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully created port: c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-5c4d554a-ac9a-47a2-8f9e-44bba9dcf497 req-c31df00d-cb14-4bde-aad1-4a4bd4c8fea3 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received event network-vif-plugged-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5c4d554a-ac9a-47a2-8f9e-44bba9dcf497 req-c31df00d-cb14-4bde-aad1-4a4bd4c8fea3 service nova] Acquiring lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5c4d554a-ac9a-47a2-8f9e-44bba9dcf497 req-c31df00d-cb14-4bde-aad1-4a4bd4c8fea3 service nova] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5c4d554a-ac9a-47a2-8f9e-44bba9dcf497 req-c31df00d-cb14-4bde-aad1-4a4bd4c8fea3 service nova] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-5c4d554a-ac9a-47a2-8f9e-44bba9dcf497 req-c31df00d-cb14-4bde-aad1-4a4bd4c8fea3 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] No waiting events found dispatching network-vif-plugged-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:43 user nova-compute[75342]: WARNING nova.compute.manager [req-5c4d554a-ac9a-47a2-8f9e-44bba9dcf497 req-c31df00d-cb14-4bde-aad1-4a4bd4c8fea3 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received unexpected event network-vif-plugged-90788e52-2039-4374-bf9a-a77637f0752d for instance with vm_state active and task_state None.
Nov 16 18:00:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:43 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully updated port: 113082fe-16a5-4f84-9632-ea793bef528a {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-83eda278-bf07-45e0-922b-ddaf0945538b req-ce584a10-0469-47ca-91d0-add168d23851 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-changed-113082fe-16a5-4f84-9632-ea793bef528a {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-83eda278-bf07-45e0-922b-ddaf0945538b req-ce584a10-0469-47ca-91d0-add168d23851 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing instance network info cache due to event network-changed-113082fe-16a5-4f84-9632-ea793bef528a. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-83eda278-bf07-45e0-922b-ddaf0945538b req-ce584a10-0469-47ca-91d0-add168d23851 service nova] Acquiring lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-83eda278-bf07-45e0-922b-ddaf0945538b req-ce584a10-0469-47ca-91d0-add168d23851 service nova] Acquired lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG nova.network.neutron [req-83eda278-bf07-45e0-922b-ddaf0945538b req-ce584a10-0469-47ca-91d0-add168d23851 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing network info cache for port 113082fe-16a5-4f84-9632-ea793bef528a {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG nova.network.neutron [req-83eda278-bf07-45e0-922b-ddaf0945538b req-ce584a10-0469-47ca-91d0-add168d23851 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully created port: 33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG nova.network.neutron [req-83eda278-bf07-45e0-922b-ddaf0945538b req-ce584a10-0469-47ca-91d0-add168d23851 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-83eda278-bf07-45e0-922b-ddaf0945538b req-ce584a10-0469-47ca-91d0-add168d23851 service nova] Releasing lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:44 user nova-compute[75342]: INFO nova.virt.block_device [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Booting with volume bb621983-7294-4b66-b3ce-0ed6d8fe156b at /dev/vdb
Nov 16 18:00:44 user nova-compute[75342]: DEBUG os_brick.utils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d36f7d9-480e-4862-8489-56e2c238dbfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcf0b63-2178-4f31-874e-e8ac1f27f4c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1973ccd-95be-4e3f-b9dc-1a99a20e5648]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aa38da-031e-482d-a2b1-fdf237121f77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received event network-vif-plugged-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Acquiring lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] No waiting events found dispatching network-vif-plugged-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:45 user nova-compute[75342]: WARNING nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received unexpected event network-vif-plugged-90788e52-2039-4374-bf9a-a77637f0752d for instance with vm_state active and task_state None.
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:45 user nova-compute[75342]: WARNING nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received unexpected event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with vm_state active and task_state None.
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:45 user nova-compute[75342]: WARNING nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received unexpected event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with vm_state active and task_state None.
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] No waiting events found dispatching network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:45 user nova-compute[75342]: WARNING nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received unexpected event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 for instance with vm_state active and task_state None.
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] No waiting events found dispatching network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:45 user nova-compute[75342]: WARNING nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received unexpected event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 for instance with vm_state active and task_state None.
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-vif-plugged-f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] No waiting events found dispatching network-vif-plugged-f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:45 user nova-compute[75342]: WARNING nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received unexpected event network-vif-plugged-f1d3a970-40d8-420b-b632-c0231545cd41 for instance with vm_state active and task_state None.
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-vif-plugged-f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] No waiting events found dispatching network-vif-plugged-f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:45 user nova-compute[75342]: WARNING nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received unexpected event network-vif-plugged-f1d3a970-40d8-420b-b632-c0231545cd41 for instance with vm_state active and task_state None.
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Received event network-vif-plugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Acquiring lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] Lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] No waiting events found dispatching network-vif-plugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:45 user nova-compute[75342]: WARNING nova.compute.manager [req-17f2d845-b761-49b2-8532-8d224146e61b req-1ab98a71-0dbb-4f44-a261-ecd6469e6b67 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Received unexpected event network-vif-plugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 for instance with vm_state active and task_state None.
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:45 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:00:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9067a201-cf34-47cf-80e0-e5aaeba3ecad]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully updated port: b4df0294-42bc-4bf2-9eb7-a2e39f845032 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG os_brick.utils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] <== get_connector_properties: return (217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating existing volume attachment record: 34392462-865b-421d-9afc-7b039cb8e6fc {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:00:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully created port: 553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:00:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully updated port: 0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-10b3b88e-a4bd-48ba-8f87-b32055fe15d7 req-45a67907-9e32-4d53-8c00-9ec37eec51bb service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-changed-b4df0294-42bc-4bf2-9eb7-a2e39f845032 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-10b3b88e-a4bd-48ba-8f87-b32055fe15d7 req-45a67907-9e32-4d53-8c00-9ec37eec51bb service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing instance network info cache due to event network-changed-b4df0294-42bc-4bf2-9eb7-a2e39f845032. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-10b3b88e-a4bd-48ba-8f87-b32055fe15d7 req-45a67907-9e32-4d53-8c00-9ec37eec51bb service nova] Acquiring lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-10b3b88e-a4bd-48ba-8f87-b32055fe15d7 req-45a67907-9e32-4d53-8c00-9ec37eec51bb service nova] Acquired lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:46 user nova-compute[75342]: DEBUG nova.network.neutron [req-10b3b88e-a4bd-48ba-8f87-b32055fe15d7 req-45a67907-9e32-4d53-8c00-9ec37eec51bb service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing network info cache for port b4df0294-42bc-4bf2-9eb7-a2e39f845032 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:46 user nova-compute[75342]: DEBUG nova.network.neutron [req-10b3b88e-a4bd-48ba-8f87-b32055fe15d7 req-45a67907-9e32-4d53-8c00-9ec37eec51bb service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:46 user nova-compute[75342]: DEBUG nova.network.neutron [req-10b3b88e-a4bd-48ba-8f87-b32055fe15d7 req-45a67907-9e32-4d53-8c00-9ec37eec51bb service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-10b3b88e-a4bd-48ba-8f87-b32055fe15d7 req-45a67907-9e32-4d53-8c00-9ec37eec51bb service nova] Releasing lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully updated port: ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Received event network-vif-plugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] Acquiring lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] Lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] Lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] No waiting events found dispatching network-vif-plugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:47 user nova-compute[75342]: WARNING nova.compute.manager [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Received unexpected event network-vif-plugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 for instance with vm_state active and task_state None.
Nov 16 18:00:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received event network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] Acquiring lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] No waiting events found dispatching network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:47 user nova-compute[75342]: WARNING nova.compute.manager [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received unexpected event network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 for instance with vm_state active and task_state None.
Nov 16 18:00:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received event network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] Acquiring lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] No waiting events found dispatching network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:00:47 user nova-compute[75342]: WARNING nova.compute.manager [req-c21473a1-694c-4258-88d0-d71a13ae74d1 req-aae5d49d-cda0-4420-a675-5091ad6f6e02 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received unexpected event network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 for instance with vm_state active and task_state None.
Nov 16 18:00:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully updated port: 525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully updated port: 6af300a9-e32e-4005-bcc0-25cf02d3d478 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:48 user nova-compute[75342]: INFO nova.virt.block_device [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Booting with volume 604406f2-9c75-40a2-8292-531fc9e426fa at /dev/vdc
Nov 16 18:00:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-changed-0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing instance network info cache due to event network-changed-0c243b55-8e7b-406e-8404-da8441b7d178. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Acquiring lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Acquired lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing network info cache for port 0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG os_brick.utils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bbeda7-5925-4c84-9736-f169ef9370be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7e95eb-5da1-4949-a09f-4e4dfb361954]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fce5fec-bb52-4c1c-8ba0-1893483f2e46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[41672fbf-6afb-4aee-90ed-e8f66b3129c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:48 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[37defbd0-9f03-4f4b-a9a3-e4274386ada7]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG os_brick.utils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating existing volume attachment record: 81d11b13-8aa6-47f6-adc8-f8e7f2d844c7 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully updated port: 76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Releasing lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-changed-ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing instance network info cache due to event network-changed-ff4eefd7-eda6-4556-b56b-12636302e052. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Acquiring lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Acquired lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:48 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing network info cache for port ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Successfully updated port: 5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquired lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-b041a199-0035-41b0-819d-5b2a243ba59e req-09bab32d-1911-4434-9cc6-9a0945686975 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-changed-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-b041a199-0035-41b0-819d-5b2a243ba59e req-09bab32d-1911-4434-9cc6-9a0945686975 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing instance network info cache due to event network-changed-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b041a199-0035-41b0-819d-5b2a243ba59e req-09bab32d-1911-4434-9cc6-9a0945686975 service nova] Acquiring lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully updated port: c58d7330-f3b0-4fe2-8f24-687f27f94b1b {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Releasing lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-changed-525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing instance network info cache due to event network-changed-525600ed-9b60-41f1-b353-65ca202dbb85. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Acquiring lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully updated port: 7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-changed-76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing instance network info cache due to event network-changed-76cba993-b3d2-4572-9717-ed57282839e3. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] Acquiring lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:50 user nova-compute[75342]: INFO nova.virt.block_device [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Booting with volume 75a9e17e-0e24-4729-bd1d-66c9d7cafefa at /dev/vdc
Nov 16 18:00:50 user nova-compute[75342]: DEBUG os_brick.utils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully updated port: c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[959d04b5-4720-4e9e-8341-da93d95f5add]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[11867f1a-0be8-4956-abc9-1b9c1f551144]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[607271c0-8409-4d4e-b076-dbd9ee419370]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[10991b97-6147-4d09-af87-7fc20834d4de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:00:50 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:00:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[af792ab3-7c4e-4ca8-adf9-4f51573eb2e0]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG os_brick.utils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:50 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating existing volume attachment record: e0819a69-2fdf-4415-b199-53874a439a15 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:00:51 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully updated port: 33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:51 user nova-compute[75342]: DEBUG nova.network.neutron [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating instance_info_cache with network_info: [{"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Releasing lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Instance network_info: |[{"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:00:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b041a199-0035-41b0-819d-5b2a243ba59e req-09bab32d-1911-4434-9cc6-9a0945686975 service nova] Acquired lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-b041a199-0035-41b0-819d-5b2a243ba59e req-09bab32d-1911-4434-9cc6-9a0945686975 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing network info cache for port 5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-b041a199-0035-41b0-819d-5b2a243ba59e req-09bab32d-1911-4434-9cc6-9a0945686975 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updated VIF entry in instance network info cache for port 5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-b041a199-0035-41b0-819d-5b2a243ba59e req-09bab32d-1911-4434-9cc6-9a0945686975 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating instance_info_cache with network_info: [{"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b041a199-0035-41b0-819d-5b2a243ba59e req-09bab32d-1911-4434-9cc6-9a0945686975 service nova] Releasing lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Acquired lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing network info cache for port 525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Successfully updated port: 553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquired lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updated VIF entry in instance network info cache for port 525600ed-9b60-41f1-b353-65ca202dbb85. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating instance_info_cache with network_info: [{"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Releasing lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-changed-6af300a9-e32e-4005-bcc0-25cf02d3d478 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing instance network info cache due to event network-changed-6af300a9-e32e-4005-bcc0-25cf02d3d478. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Acquiring lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] Acquired lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.network.neutron [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing network info cache for port 76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-changed-c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing instance network info cache due to event network-changed-c3caa036-462f-4be2-b871-21063f9391e6. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] Acquiring lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.network.neutron [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updated VIF entry in instance network info cache for port 76cba993-b3d2-4572-9717-ed57282839e3. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.network.neutron [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating instance_info_cache with network_info: [{"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] Releasing lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-changed-c58d7330-f3b0-4fe2-8f24-687f27f94b1b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing instance network info cache due to event network-changed-c58d7330-f3b0-4fe2-8f24-687f27f94b1b. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] Acquiring lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:00:54 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Creating image(s)
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Ensure instance console log exists: /opt/stack/data/nova/instances/77a26e02-f97e-4911-9dd4-3f6f30d92edc/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Start _get_guest_xml network_info=[{"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '036bbc74-ff0d-4e55-9688-430095a04ea7', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crQisPpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '77a26e02-f97e-4911-9dd4-3f6f30d92edc', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7e2262c-ca41-489a-98f8-0bfd89ecbd19', 'serial': 'c7e2262c-ca41-489a-98f8-0bfd89ecbd19'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': 'ed06ff9f-23f4-4fe8-9d43-1de36396c047', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ILyizUov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '77a26e02-f97e-4911-9dd4-3f6f30d92edc', 'attached_at': '', 'detached_at': '', 'volume_id': '723ba8e7-ee09-4572-82e8-6933d6cee584', 'serial': '723ba8e7-ee09-4572-82e8-6933d6cee584'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '81d11b13-8aa6-47f6-adc8-f8e7f2d844c7', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyMONUpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '77a26e02-f97e-4911-9dd4-3f6f30d92edc', 'attached_at': '', 'detached_at': '', 'volume_id': '604406f2-9c75-40a2-8292-531fc9e426fa', 'serial': '604406f2-9c75-40a2-8292-531fc9e426fa'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:00:54 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:54 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crQisPpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:54 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:54 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:54 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating instance_info_cache with network_info: [{"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6e2a92-e4e7-4be9-bf24-a0e8e390b9b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:00:54 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Releasing lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Instance network_info: |[{"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Acquired lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing network info cache for port 6af300a9-e32e-4005-bcc0-25cf02d3d478 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ce13f-47a5-4e7c-8c93-f026c7e05c3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19] added
Nov 16 18:00:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[464fd974-59c4-41b7-b047-2e1c274a2928]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ae5d03-ec49-43bb-bf0a-d47f65b5c040]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crQisPpg {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crQisPpg" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aa80c0-6bba-4b3b-b741-e4734a367384]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'crQisPpg'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7bcb7c-554a-40c7-a8e9-a238c2cc5c84]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0d5621-bbff-46ed-92f5-99474b8936c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5966e3d2-45f4-4ac5-bc81-e23e30dff461]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19, portal: 172.16.0.220,3260]
Nov 16 18:00:54 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19, portal: 172.16.0.220,3260] successful.
Nov 16 18:00:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dcc56f-7b69-4cef-9aee-cdfbfd5db46b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1ed78a-f91c-45b1-a626-97ebc74597d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:54 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:54 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcde435d-ee24-4e3e-99b3-63e3bff92fd3]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crQisPpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updated VIF entry in instance network info cache for port 6af300a9-e32e-4005-bcc0-25cf02d3d478. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating instance_info_cache with network_info: [{"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d7d1510e-a929-4451-b3c8-d9e63ce61ffd req-506f949e-e83d-49b2-953e-2d4ca0a0332e service nova] Releasing lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] Acquired lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing network info cache for port c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updated VIF entry in instance network info cache for port c3caa036-462f-4be2-b871-21063f9391e6. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating instance_info_cache with network_info: [{"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] Releasing lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-changed-33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing instance network info cache due to event network-changed-33e085a5-f694-4271-8ac1-76b32841c773. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] Acquiring lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] Acquired lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing network info cache for port 33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23135323834393865', 'path': '/dev/sdc'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135323834393865', 'path': '/dev/sdc'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ILyizUov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:55 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:55 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:55 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafe8341-92b7-4def-872c-f214ed3f1894]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:00:55 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f9c582-2037-4860-a236-0d27f2a8fe9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584] added
Nov 16 18:00:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b395b3b-ef5b-4f73-902c-8f3b53fc75d4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4baa5b9-703a-4970-86c5-99b95cf2ff4f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ILyizUov {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ILyizUov" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f897e615-f957-456c-82bc-d22e5c01a9ea]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ILyizUov'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updated VIF entry in instance network info cache for port 33e085a5-f694-4271-8ac1-76b32841c773. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating instance_info_cache with network_info: [{"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[48406888-60c5-48ec-bfc3-f52d3e52bafa]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] Releasing lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-changed-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing instance network info cache due to event network-changed-553cae05-4cfc-4ddb-b0a4-10440f8d02c2. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] Acquiring lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] Acquired lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing network info cache for port 553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[337937ca-1271-4dc7-9585-4db0408fe1c5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:55 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:55 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bf10e5-0f26-45d7-b1a3-925b6b72ef51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584, portal: 172.16.0.220,3260]
Nov 16 18:00:55 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584, portal: 172.16.0.220,3260] successful.
Nov 16 18:00:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bbf253-9b0a-4ea7-b569-fb76e82f188a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a472f27b-c846-4a6e-bd38-ed854767db21]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:55 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:55 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:55 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:55 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[274dd2e0-4389-463a-bd7d-b0440ea1ed8f]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:00:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ILyizUov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updated VIF entry in instance network info cache for port 553cae05-4cfc-4ddb-b0a4-10440f8d02c2. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating instance_info_cache with network_info: [{"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58ed1700-0a30-411b-a48c-443e4f994a61 req-0e9e6ab0-124f-4006-a43f-667fe627ef0b service nova] Releasing lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] Acquired lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing network info cache for port c58d7330-f3b0-4fe2-8f24-687f27f94b1b {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:00:56 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Creating image(s)
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Ensure instance console log exists: /opt/stack/data/nova/instances/89e3e5a3-2d3c-46d8-b155-3dc429531e00/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Start _get_guest_xml network_info=[{"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cb1cec4f-b273-4bfe-b3f2-5fbe829fbb04', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGqXAmUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89e3e5a3-2d3c-46d8-b155-3dc429531e00', 'attached_at': '', 'detached_at': '', 'volume_id': '6ed6108f-8574-49bc-be9e-1ff3bcf1e56c', 'serial': '6ed6108f-8574-49bc-be9e-1ff3bcf1e56c'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '34392462-865b-421d-9afc-7b039cb8e6fc', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkNiKdtE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89e3e5a3-2d3c-46d8-b155-3dc429531e00', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb621983-7294-4b66-b3ce-0ed6d8fe156b', 'serial': 'bb621983-7294-4b66-b3ce-0ed6d8fe156b'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': 'e0819a69-2fdf-4415-b199-53874a439a15', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEWNsMGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89e3e5a3-2d3c-46d8-b155-3dc429531e00', 'attached_at': '', 'detached_at': '', 'volume_id': '75a9e17e-0e24-4729-bd1d-66c9d7cafefa', 'serial': '75a9e17e-0e24-4729-bd1d-66c9d7cafefa'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:00:56 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:56 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGqXAmUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:56 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updated VIF entry in instance network info cache for port c58d7330-f3b0-4fe2-8f24-687f27f94b1b. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating instance_info_cache with network_info: [{"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] Releasing lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-changed-7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing instance network info cache due to event network-changed-7eb0e0f5-10e0-47fa-85db-40177eec8aed. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] Acquiring lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] Acquired lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing network info cache for port 7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23735646338346161', 'path': '/dev/sdd'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735646338346161', 'path': '/dev/sdd'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.529s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:56 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:56 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:00:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faffc10-b99d-402a-8cfd-59fa3302c526]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:00:57 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyMONUpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:57 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e7ae0-9226-4461-b52d-5c5997c243a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c] added
Nov 16 18:00:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bda5374-138a-4eea-ad52-77bb56a57c59]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d49d2ad-6623-410b-b66d-87434408e432]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGqXAmUF {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGqXAmUF" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7885c0-8f08-4a8a-9efc-1c860dc6b47f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGqXAmUF'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c6a5b-777c-4a67-9397-05470e43760b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG nova.network.neutron [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updated VIF entry in instance network info cache for port 7eb0e0f5-10e0-47fa-85db-40177eec8aed. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG nova.network.neutron [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating instance_info_cache with network_info: [{"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c670de00-12de-4ce6-824a-db9344863a85]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:57 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:57 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:57 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:57 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9433898-afb3-42cc-ad85-8b664a20faa5 req-bdbe1ccd-d80d-460a-a225-433ae1ca36a1 service nova] Releasing lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[042e99b0-afc0-4d41-9988-e8902525813e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c, portal: 172.16.0.220,3260]
Nov 16 18:00:57 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c, portal: 172.16.0.220,3260] successful.
Nov 16 18:00:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[912a06be-416d-4f09-8a1f-8cbea458e2ca]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e765d0-1184-43a7-80c1-8f76d71ab99b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:57 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:57 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:57 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:00:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:57 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:57 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:57 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:00:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5545eb6f-97c8-48fc-bb3a-c5afa596db47]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGqXAmUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:00:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] <== connect_volume: return (1842ms) {'type': 'block', 'scsi_wwn': '23934356432373164', 'path': '/dev/sde'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934356432373164', 'path': '/dev/sde'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.259s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:58 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:58 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[294e204a-5029-44cd-9f28-9ee68f96e63e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:00:58 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkNiKdtE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:00:58 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecbb984-a56e-447f-854f-fcde8435d547]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa] added
Nov 16 18:00:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcddafba-7938-49b8-9d30-1f94f502f3ec]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[906802cc-2727-47be-9ff4-5e05cd0d2abc]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyMONUpI {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyMONUpI" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0cb808-562e-4146-bbaa-e797c7085bce]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cyMONUpI'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f067d9-ef2e-4759-9a8d-625b7b8695f2]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[124d11fa-6fb0-4bd4-9f43-f3e35dd785b4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:00:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:00:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f34b6b8-aca7-432f-8727-b64dd9cf83f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa, portal: 172.16.0.220,3260]
Nov 16 18:00:58 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa, portal: 172.16.0.220,3260] successful.
Nov 16 18:00:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0e9d81-dedd-42d9-8941-6f6b5b25da3e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2af2fd-e221-4dfc-bea8-2162f41ddd8d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:00:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:00:58 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:00:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4743fc-c894-4a2b-85f6-2259fa236b51]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:00:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyMONUpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] <== connect_volume: return (2570ms) {'type': 'block', 'scsi_wwn': '26531376265653162', 'path': '/dev/sdf'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531376265653162', 'path': '/dev/sdf'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.286s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:59 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:00:59 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[634d0754-df49-49a6-b197-0e2eec91025c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:00:59 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=b611b37d-a062-41de-9792-7a3c5c60cfc4,network=Network(9355741c-1087-431f-845c-cc54af29620b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb611b37d-a0') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=113082fe-16a5-4f84-9632-ea793bef528a,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap113082fe-16') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:db:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4df0294-42bc-4bf2-9eb7-a2e39f845032,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4df0294-42') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:90:82,bridge_name='br-int',has_traffic_filtering=True,id=0c243b55-8e7b-406e-8404-da8441b7d178,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c243b55-8e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=525600ed-9b60-41f1-b353-65ca202dbb85,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525600ed-9b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:b9,bridge_name='br-int',has_traffic_filtering=True,id=76cba993-b3d2-4572-9717-ed57282839e3,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76cba993-b3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:9b:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4ae8c0-bd') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.objects.instance [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lazy-loading 'pci_devices' on Instance uuid 77a26e02-f97e-4911-9dd4-3f6f30d92edc {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a3f68c-5b39-4d5b-aaf1-f370b189a85f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b] added
Nov 16 18:00:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:00:59 user nova-compute[75342]:   <uuid>77a26e02-f97e-4911-9dd4-3f6f30d92edc</uuid>
Nov 16 18:00:59 user nova-compute[75342]:   <name>instance-0000000b</name>
Nov 16 18:00:59 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:00:59 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:00:59 user nova-compute[75342]:   <metadata>
Nov 16 18:00:59 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:00:59 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:00:59 user nova-compute[75342]:       <nova:name>tempest-device-tagging-server-1274283793</nova:name>
Nov 16 18:00:59 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:00:54</nova:creationTime>
Nov 16 18:00:59 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:00:59 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:00:59 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:00:59 user nova-compute[75342]:       <nova:owner>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:user uuid="276674d90afe48ca96935377dba663ff">tempest-TaggedBootDevicesTest-373046117-project-member</nova:user>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:project uuid="266d252d115e4d61b5c7830bc4c4b4a7">tempest-TaggedBootDevicesTest-373046117</nova:project>
Nov 16 18:00:59 user nova-compute[75342]:       </nova:owner>
Nov 16 18:00:59 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:00:59 user nova-compute[75342]:       <nova:ports>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:port uuid="b611b37d-a062-41de-9792-7a3c5c60cfc4">
Nov 16 18:00:59 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 18:00:59 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:port uuid="113082fe-16a5-4f84-9632-ea793bef528a">
Nov 16 18:00:59 user nova-compute[75342]:           <nova:ip type="fixed" address="10.1.1.238" ipVersion="4"/>
Nov 16 18:00:59 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:port uuid="b4df0294-42bc-4bf2-9eb7-a2e39f845032">
Nov 16 18:00:59 user nova-compute[75342]:           <nova:ip type="fixed" address="10.1.1.147" ipVersion="4"/>
Nov 16 18:00:59 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:port uuid="0c243b55-8e7b-406e-8404-da8441b7d178">
Nov 16 18:00:59 user nova-compute[75342]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
Nov 16 18:00:59 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:port uuid="525600ed-9b60-41f1-b353-65ca202dbb85">
Nov 16 18:00:59 user nova-compute[75342]:           <nova:ip type="fixed" address="10.1.1.90" ipVersion="4"/>
Nov 16 18:00:59 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:port uuid="76cba993-b3d2-4572-9717-ed57282839e3">
Nov 16 18:00:59 user nova-compute[75342]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 18:00:59 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:59 user nova-compute[75342]:         <nova:port uuid="5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097">
Nov 16 18:00:59 user nova-compute[75342]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 18:00:59 user nova-compute[75342]:         </nova:port>
Nov 16 18:00:59 user nova-compute[75342]:       </nova:ports>
Nov 16 18:00:59 user nova-compute[75342]:     </nova:instance>
Nov 16 18:00:59 user nova-compute[75342]:   </metadata>
Nov 16 18:00:59 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:00:59 user nova-compute[75342]:     <system>
Nov 16 18:00:59 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:00:59 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:00:59 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:00:59 user nova-compute[75342]:       <entry name="serial">77a26e02-f97e-4911-9dd4-3f6f30d92edc</entry>
Nov 16 18:00:59 user nova-compute[75342]:       <entry name="uuid">77a26e02-f97e-4911-9dd4-3f6f30d92edc</entry>
Nov 16 18:00:59 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:00:59 user nova-compute[75342]:     </system>
Nov 16 18:00:59 user nova-compute[75342]:   </sysinfo>
Nov 16 18:00:59 user nova-compute[75342]:   <os>
Nov 16 18:00:59 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:00:59 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:00:59 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:00:59 user nova-compute[75342]:   </os>
Nov 16 18:00:59 user nova-compute[75342]:   <features>
Nov 16 18:00:59 user nova-compute[75342]:     <acpi/>
Nov 16 18:00:59 user nova-compute[75342]:     <apic/>
Nov 16 18:00:59 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:00:59 user nova-compute[75342]:   </features>
Nov 16 18:00:59 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:00:59 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:00:59 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:00:59 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:00:59 user nova-compute[75342]:   </clock>
Nov 16 18:00:59 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:00:59 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:00:59 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:00:59 user nova-compute[75342]:   </cpu>
Nov 16 18:00:59 user nova-compute[75342]:   <devices>
Nov 16 18:00:59 user nova-compute[75342]:     <disk type="file" device="cdrom">
Nov 16 18:00:59 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 18:00:59 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/77a26e02-f97e-4911-9dd4-3f6f30d92edc/disk.config"/>
Nov 16 18:00:59 user nova-compute[75342]:       <target dev="hda" bus="ide"/>
Nov 16 18:00:59 user nova-compute[75342]:     </disk>
Nov 16 18:00:59 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:00:59 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:00:59 user nova-compute[75342]:       <source dev="/dev/sdc"/>
Nov 16 18:00:59 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:00:59 user nova-compute[75342]:       <serial>c7e2262c-ca41-489a-98f8-0bfd89ecbd19</serial>
Nov 16 18:00:59 user nova-compute[75342]:     </disk>
Nov 16 18:00:59 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:00:59 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:00:59 user nova-compute[75342]:       <source dev="/dev/sdd"/>
Nov 16 18:00:59 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:00:59 user nova-compute[75342]:       <serial>723ba8e7-ee09-4572-82e8-6933d6cee584</serial>
Nov 16 18:00:59 user nova-compute[75342]:     </disk>
Nov 16 18:00:59 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:00:59 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:00:59 user nova-compute[75342]:       <source dev="/dev/sdf"/>
Nov 16 18:00:59 user nova-compute[75342]:       <target dev="vdc" bus="virtio"/>
Nov 16 18:00:59 user nova-compute[75342]:       <serial>604406f2-9c75-40a2-8292-531fc9e426fa</serial>
Nov 16 18:00:59 user nova-compute[75342]:     </disk>
Nov 16 18:00:59 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:59 user nova-compute[75342]:       <mac address="fa:16:3e:b7:a2:ab"/>
Nov 16 18:00:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:59 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:59 user nova-compute[75342]:       <target dev="tapb611b37d-a0"/>
Nov 16 18:00:59 user nova-compute[75342]:     </interface>
Nov 16 18:00:59 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:59 user nova-compute[75342]:       <mac address="fa:16:3e:e3:d6:ad"/>
Nov 16 18:00:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:59 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:59 user nova-compute[75342]:       <target dev="tap113082fe-16"/>
Nov 16 18:00:59 user nova-compute[75342]:     </interface>
Nov 16 18:00:59 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:59 user nova-compute[75342]:       <mac address="fa:16:3e:5b:db:b5"/>
Nov 16 18:00:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:59 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:59 user nova-compute[75342]:       <target dev="tapb4df0294-42"/>
Nov 16 18:00:59 user nova-compute[75342]:     </interface>
Nov 16 18:00:59 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:59 user nova-compute[75342]:       <mac address="fa:16:3e:7f:90:82"/>
Nov 16 18:00:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:59 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:59 user nova-compute[75342]:       <target dev="tap0c243b55-8e"/>
Nov 16 18:00:59 user nova-compute[75342]:     </interface>
Nov 16 18:00:59 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:59 user nova-compute[75342]:       <mac address="fa:16:3e:74:66:a0"/>
Nov 16 18:00:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:59 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:59 user nova-compute[75342]:       <target dev="tap525600ed-9b"/>
Nov 16 18:00:59 user nova-compute[75342]:     </interface>
Nov 16 18:00:59 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:59 user nova-compute[75342]:       <mac address="fa:16:3e:f0:e7:b9"/>
Nov 16 18:00:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:59 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:59 user nova-compute[75342]:       <target dev="tap76cba993-b3"/>
Nov 16 18:00:59 user nova-compute[75342]:     </interface>
Nov 16 18:00:59 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:00:59 user nova-compute[75342]:       <mac address="fa:16:3e:93:9b:0e"/>
Nov 16 18:00:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:59 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:00:59 user nova-compute[75342]:       <target dev="tap5b4ae8c0-bd"/>
Nov 16 18:00:59 user nova-compute[75342]:     </interface>
Nov 16 18:00:59 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:00:59 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/77a26e02-f97e-4911-9dd4-3f6f30d92edc/console.log" append="off"/>
Nov 16 18:00:59 user nova-compute[75342]:     </serial>
Nov 16 18:00:59 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:00:59 user nova-compute[75342]:     <video>
Nov 16 18:00:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:00:59 user nova-compute[75342]:     </video>
Nov 16 18:00:59 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:00:59 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:00:59 user nova-compute[75342]:     </rng>
Nov 16 18:00:59 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:00:59 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:00:59 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:00:59 user nova-compute[75342]:     </memballoon>
Nov 16 18:00:59 user nova-compute[75342]:   </devices>
Nov 16 18:00:59 user nova-compute[75342]: </domain>
Nov 16 18:00:59 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=b611b37d-a062-41de-9792-7a3c5c60cfc4,network=Network(9355741c-1087-431f-845c-cc54af29620b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb611b37d-a0') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=b611b37d-a062-41de-9792-7a3c5c60cfc4,network=Network(9355741c-1087-431f-845c-cc54af29620b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb611b37d-a0') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '777d5900-3131-5efc-a3e1-46ba334ee914', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d15291-4512-4bea-b299-4ce11aa6b37e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb611b37d-a0, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb611b37d-a0, col_values=(('qos', UUID('f4ffedc0-ec48-4142-8f51-402fe5ce4280')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb611b37d-a0, col_values=(('external_ids', {'iface-id': 'b611b37d-a062-41de-9792-7a3c5c60cfc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:a2:ab', 'vm-uuid': '77a26e02-f97e-4911-9dd4-3f6f30d92edc'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4737550c-1553-45bd-8a9b-e9200cb45d0e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: INFO os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=b611b37d-a062-41de-9792-7a3c5c60cfc4,network=Network(9355741c-1087-431f-845c-cc54af29620b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb611b37d-a0')
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=113082fe-16a5-4f84-9632-ea793bef528a,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap113082fe-16') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=113082fe-16a5-4f84-9632-ea793bef528a,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap113082fe-16') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkNiKdtE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04732dc4-8e4e-56b4-8a76-36d0eceeb5df', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkNiKdtE" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[946655e4-5515-4265-aa7b-9d4861ad7f26]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rkNiKdtE'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap113082fe-16, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap113082fe-16, col_values=(('qos', UUID('70b71bd3-8de3-4d76-af61-45b194e0bc54')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap113082fe-16, col_values=(('external_ids', {'iface-id': '113082fe-16a5-4f84-9632-ea793bef528a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:d6:ad', 'vm-uuid': '77a26e02-f97e-4911-9dd4-3f6f30d92edc'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd04db5f-a46e-4d1e-8b83-8c978d920d75]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: INFO os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=113082fe-16a5-4f84-9632-ea793bef528a,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap113082fe-16')
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:db:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4df0294-42bc-4bf2-9eb7-a2e39f845032,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4df0294-42') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:db:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4df0294-42bc-4bf2-9eb7-a2e39f845032,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4df0294-42') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29cbfb76-4435-5abf-bac5-8095b8ede335', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd795c9-3887-457a-b606-5616a106951f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:00:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:00:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4df0294-42, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4df0294-42, col_values=(('qos', UUID('8bf47355-0c34-4a19-9942-8bc5e56d5194')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4df0294-42, col_values=(('external_ids', {'iface-id': 'b4df0294-42bc-4bf2-9eb7-a2e39f845032', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:db:b5', 'vm-uuid': '77a26e02-f97e-4911-9dd4-3f6f30d92edc'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: INFO os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:db:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4df0294-42bc-4bf2-9eb7-a2e39f845032,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4df0294-42')
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:90:82,bridge_name='br-int',has_traffic_filtering=True,id=0c243b55-8e7b-406e-8404-da8441b7d178,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c243b55-8e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:90:82,bridge_name='br-int',has_traffic_filtering=True,id=0c243b55-8e7b-406e-8404-da8441b7d178,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c243b55-8e') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e09e19b-63f0-529e-9fa9-96948f7c3ad7', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e154db02-8276-439e-8e25-b3189b4f70eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b, portal: 172.16.0.220,3260]
Nov 16 18:00:59 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b, portal: 172.16.0.220,3260] successful.
Nov 16 18:00:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c243b55-8e, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c243b55-8e, col_values=(('qos', UUID('a04650b8-f47b-497c-a36e-6e721abac482')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c243b55-8e, col_values=(('external_ids', {'iface-id': '0c243b55-8e7b-406e-8404-da8441b7d178', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:90:82', 'vm-uuid': '77a26e02-f97e-4911-9dd4-3f6f30d92edc'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4b597a-be2e-4776-9bda-292826965913]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: INFO os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:90:82,bridge_name='br-int',has_traffic_filtering=True,id=0c243b55-8e7b-406e-8404-da8441b7d178,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c243b55-8e')
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=525600ed-9b60-41f1-b353-65ca202dbb85,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525600ed-9b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=525600ed-9b60-41f1-b353-65ca202dbb85,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525600ed-9b') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ae9166-d86f-4c5c-bcbc-88a54bee67c5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:00:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:00:59 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:00:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a6b3e34-fba3-51d9-9119-343ff85908ff', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7123a462-6be5-4a75-bf39-8eebbcb3fd56]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkNiKdtE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap525600ed-9b, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap525600ed-9b, col_values=(('qos', UUID('1a7a721f-4dda-46b9-94be-1e59633a40b2')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap525600ed-9b, col_values=(('external_ids', {'iface-id': '525600ed-9b60-41f1-b353-65ca202dbb85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:66:a0', 'vm-uuid': '77a26e02-f97e-4911-9dd4-3f6f30d92edc'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:00:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: INFO os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=525600ed-9b60-41f1-b353-65ca202dbb85,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525600ed-9b')
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:b9,bridge_name='br-int',has_traffic_filtering=True,id=76cba993-b3d2-4572-9717-ed57282839e3,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76cba993-b3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:b9,bridge_name='br-int',has_traffic_filtering=True,id=76cba993-b3d2-4572-9717-ed57282839e3,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76cba993-b3') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '504f4a68-7201-535c-8af1-33eae6bd2fc0', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76cba993-b3, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76cba993-b3, col_values=(('qos', UUID('c42eadd8-b3d0-4d9d-83d7-fcc63c1272f8')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76cba993-b3, col_values=(('external_ids', {'iface-id': '76cba993-b3d2-4572-9717-ed57282839e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:e7:b9', 'vm-uuid': '77a26e02-f97e-4911-9dd4-3f6f30d92edc'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: INFO os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:b9,bridge_name='br-int',has_traffic_filtering=True,id=76cba993-b3d2-4572-9717-ed57282839e3,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76cba993-b3')
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:9b:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4ae8c0-bd') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:9b:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4ae8c0-bd') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b06f4e13-afe0-551d-8e5d-ef67af21b7f3', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b4ae8c0-bd, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b4ae8c0-bd, col_values=(('qos', UUID('7a1ee608-11ce-4558-8b14-1be7d33d1585')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b4ae8c0-bd, col_values=(('external_ids', {'iface-id': '5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:9b:0e', 'vm-uuid': '77a26e02-f97e-4911-9dd4-3f6f30d92edc'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:00 user nova-compute[75342]: INFO os_vif [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:9b:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4ae8c0-bd')
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] No BDM found with device name hda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] No VIF found with MAC fa:16:3e:b7:a2:ab, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] No VIF found with MAC fa:16:3e:74:66:a0, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:01:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Using config drive
Nov 16 18:01:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Creating config drive at /opt/stack/data/nova/instances/77a26e02-f97e-4911-9dd4-3f6f30d92edc/disk.config
Nov 16 18:01:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/77a26e02-f97e-4911-9dd4-3f6f30d92edc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0k15kvmr {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/77a26e02-f97e-4911-9dd4-3f6f30d92edc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0k15kvmr" returned: 0 in 0.067s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] <== connect_volume: return (2638ms) {'type': 'block', 'scsi_wwn': '26630646535386137', 'path': '/dev/sdg'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630646535386137', 'path': '/dev/sdg'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEWNsMGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:01:00 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:01:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:01:00 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:01:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:01:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:01:00 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:01:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a18f5f-2933-4e43-80dd-fdcdfd9e308d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:01:01 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2737d5-3a81-4587-b751-cafc219518df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa] added
Nov 16 18:01:01 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa657c0c-15c0-4fc0-a0e6-ce4862af3212]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[20299389-74eb-4946-a4c1-ad26d8c43bad]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEWNsMGi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEWNsMGi" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[adddf262-a97e-4db8-98e4-733c63acb877]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LEWNsMGi'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[956be1a0-0e9d-43e6-845e-04501caece2e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[569f9b8d-26cc-491b-b265-7e28c8e7ee7e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:01 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:01 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5392e79-953a-41ca-b1ec-24fe701fcfb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa, portal: 172.16.0.220,3260]
Nov 16 18:01:01 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa, portal: 172.16.0.220,3260] successful.
Nov 16 18:01:01 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d50f652-cb23-4284-b652-0e8a1bf6f2ad]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8246cf72-7042-4023-b75d-fdd14d6fbd44]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:01 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:01 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:01 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[95441e14-fb7d-4556-b083-31e48c630b7c]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:01:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEWNsMGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-e0778b03-423f-4033-94c5-be450b7c5ab7 req-a004f4bb-67aa-4b85-8578-5bec355a0d8a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e0778b03-423f-4033-94c5-be450b7c5ab7 req-a004f4bb-67aa-4b85-8578-5bec355a0d8a service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e0778b03-423f-4033-94c5-be450b7c5ab7 req-a004f4bb-67aa-4b85-8578-5bec355a0d8a service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e0778b03-423f-4033-94c5-be450b7c5ab7 req-a004f4bb-67aa-4b85-8578-5bec355a0d8a service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-e0778b03-423f-4033-94c5-be450b7c5ab7 req-a004f4bb-67aa-4b85-8578-5bec355a0d8a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:02 user nova-compute[75342]: WARNING nova.compute.manager [req-e0778b03-423f-4033-94c5-be450b7c5ab7 req-a004f4bb-67aa-4b85-8578-5bec355a0d8a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 for instance with vm_state building and task_state spawning.
Nov 16 18:01:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23030303164383866', 'path': '/dev/sdh'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030303164383866', 'path': '/dev/sdh'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:37:30,bridge_name='br-int',has_traffic_filtering=True,id=ff4eefd7-eda6-4556-b56b-12636302e052,network=Network(e1b81a93-3621-4c71-ad60-d2616fcaa07d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff4eefd7-ed') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=6af300a9-e32e-4005-bcc0-25cf02d3d478,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af300a9-e3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a6:c5,bridge_name='br-int',has_traffic_filtering=True,id=c58d7330-f3b0-4fe2-8f24-687f27f94b1b,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc58d7330-f3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ee:03,bridge_name='br-int',has_traffic_filtering=True,id=7eb0e0f5-10e0-47fa-85db-40177eec8aed,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb0e0f5-10') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:8a:04,bridge_name='br-int',has_traffic_filtering=True,id=c3caa036-462f-4be2-b871-21063f9391e6,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3caa036-46') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:5e:99,bridge_name='br-int',has_traffic_filtering=True,id=33e085a5-f694-4271-8ac1-76b32841c773,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e085a5-f6') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=553cae05-4cfc-4ddb-b0a4-10440f8d02c2,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553cae05-4c') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.objects.instance [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lazy-loading 'pci_devices' on Instance uuid 89e3e5a3-2d3c-46d8-b155-3dc429531e00 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:01:02 user nova-compute[75342]:   <uuid>89e3e5a3-2d3c-46d8-b155-3dc429531e00</uuid>
Nov 16 18:01:02 user nova-compute[75342]:   <name>instance-0000000c</name>
Nov 16 18:01:02 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:01:02 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:01:02 user nova-compute[75342]:   <metadata>
Nov 16 18:01:02 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:01:02 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:01:02 user nova-compute[75342]:       <nova:name>tempest-device-tagging-server-1784670329</nova:name>
Nov 16 18:01:02 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:00:56</nova:creationTime>
Nov 16 18:01:02 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:01:02 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:01:02 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:01:02 user nova-compute[75342]:       <nova:owner>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:user uuid="3904f422a1964577b7ffe40a188034b4">tempest-TaggedBootDevicesTest_v242-2117807047-project-member</nova:user>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:project uuid="5614cdd6149a472b93ac97406fa087ce">tempest-TaggedBootDevicesTest_v242-2117807047</nova:project>
Nov 16 18:01:02 user nova-compute[75342]:       </nova:owner>
Nov 16 18:01:02 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:01:02 user nova-compute[75342]:       <nova:ports>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:port uuid="ff4eefd7-eda6-4556-b56b-12636302e052">
Nov 16 18:01:02 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 18:01:02 user nova-compute[75342]:         </nova:port>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:port uuid="6af300a9-e32e-4005-bcc0-25cf02d3d478">
Nov 16 18:01:02 user nova-compute[75342]:           <nova:ip type="fixed" address="10.1.1.193" ipVersion="4"/>
Nov 16 18:01:02 user nova-compute[75342]:         </nova:port>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:port uuid="c58d7330-f3b0-4fe2-8f24-687f27f94b1b">
Nov 16 18:01:02 user nova-compute[75342]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Nov 16 18:01:02 user nova-compute[75342]:         </nova:port>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:port uuid="7eb0e0f5-10e0-47fa-85db-40177eec8aed">
Nov 16 18:01:02 user nova-compute[75342]:           <nova:ip type="fixed" address="10.1.1.66" ipVersion="4"/>
Nov 16 18:01:02 user nova-compute[75342]:         </nova:port>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:port uuid="c3caa036-462f-4be2-b871-21063f9391e6">
Nov 16 18:01:02 user nova-compute[75342]:           <nova:ip type="fixed" address="10.1.1.227" ipVersion="4"/>
Nov 16 18:01:02 user nova-compute[75342]:         </nova:port>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:port uuid="33e085a5-f694-4271-8ac1-76b32841c773">
Nov 16 18:01:02 user nova-compute[75342]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 18:01:02 user nova-compute[75342]:         </nova:port>
Nov 16 18:01:02 user nova-compute[75342]:         <nova:port uuid="553cae05-4cfc-4ddb-b0a4-10440f8d02c2">
Nov 16 18:01:02 user nova-compute[75342]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 18:01:02 user nova-compute[75342]:         </nova:port>
Nov 16 18:01:02 user nova-compute[75342]:       </nova:ports>
Nov 16 18:01:02 user nova-compute[75342]:     </nova:instance>
Nov 16 18:01:02 user nova-compute[75342]:   </metadata>
Nov 16 18:01:02 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:01:02 user nova-compute[75342]:     <system>
Nov 16 18:01:02 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:01:02 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:01:02 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:01:02 user nova-compute[75342]:       <entry name="serial">89e3e5a3-2d3c-46d8-b155-3dc429531e00</entry>
Nov 16 18:01:02 user nova-compute[75342]:       <entry name="uuid">89e3e5a3-2d3c-46d8-b155-3dc429531e00</entry>
Nov 16 18:01:02 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:01:02 user nova-compute[75342]:     </system>
Nov 16 18:01:02 user nova-compute[75342]:   </sysinfo>
Nov 16 18:01:02 user nova-compute[75342]:   <os>
Nov 16 18:01:02 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:01:02 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:01:02 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:01:02 user nova-compute[75342]:   </os>
Nov 16 18:01:02 user nova-compute[75342]:   <features>
Nov 16 18:01:02 user nova-compute[75342]:     <acpi/>
Nov 16 18:01:02 user nova-compute[75342]:     <apic/>
Nov 16 18:01:02 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:01:02 user nova-compute[75342]:   </features>
Nov 16 18:01:02 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:01:02 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:01:02 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:01:02 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:01:02 user nova-compute[75342]:   </clock>
Nov 16 18:01:02 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:01:02 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:01:02 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:01:02 user nova-compute[75342]:   </cpu>
Nov 16 18:01:02 user nova-compute[75342]:   <devices>
Nov 16 18:01:02 user nova-compute[75342]:     <disk type="file" device="cdrom">
Nov 16 18:01:02 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 18:01:02 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/89e3e5a3-2d3c-46d8-b155-3dc429531e00/disk.config"/>
Nov 16 18:01:02 user nova-compute[75342]:       <target dev="hda" bus="ide"/>
Nov 16 18:01:02 user nova-compute[75342]:     </disk>
Nov 16 18:01:02 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:01:02 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:01:02 user nova-compute[75342]:       <source dev="/dev/sde"/>
Nov 16 18:01:02 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:01:02 user nova-compute[75342]:       <serial>6ed6108f-8574-49bc-be9e-1ff3bcf1e56c</serial>
Nov 16 18:01:02 user nova-compute[75342]:     </disk>
Nov 16 18:01:02 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:01:02 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:01:02 user nova-compute[75342]:       <source dev="/dev/sdg"/>
Nov 16 18:01:02 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:01:02 user nova-compute[75342]:       <serial>bb621983-7294-4b66-b3ce-0ed6d8fe156b</serial>
Nov 16 18:01:02 user nova-compute[75342]:     </disk>
Nov 16 18:01:02 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:01:02 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:01:02 user nova-compute[75342]:       <source dev="/dev/sdh"/>
Nov 16 18:01:02 user nova-compute[75342]:       <target dev="vdc" bus="virtio"/>
Nov 16 18:01:02 user nova-compute[75342]:       <serial>75a9e17e-0e24-4729-bd1d-66c9d7cafefa</serial>
Nov 16 18:01:02 user nova-compute[75342]:     </disk>
Nov 16 18:01:02 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:01:02 user nova-compute[75342]:       <mac address="fa:16:3e:33:37:30"/>
Nov 16 18:01:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:01:02 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:01:02 user nova-compute[75342]:       <target dev="tapff4eefd7-ed"/>
Nov 16 18:01:02 user nova-compute[75342]:     </interface>
Nov 16 18:01:02 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:01:02 user nova-compute[75342]:       <mac address="fa:16:3e:10:c0:d0"/>
Nov 16 18:01:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:01:02 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:01:02 user nova-compute[75342]:       <target dev="tap6af300a9-e3"/>
Nov 16 18:01:02 user nova-compute[75342]:     </interface>
Nov 16 18:01:02 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:01:02 user nova-compute[75342]:       <mac address="fa:16:3e:66:a6:c5"/>
Nov 16 18:01:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:01:02 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:01:02 user nova-compute[75342]:       <target dev="tapc58d7330-f3"/>
Nov 16 18:01:02 user nova-compute[75342]:     </interface>
Nov 16 18:01:02 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:01:02 user nova-compute[75342]:       <mac address="fa:16:3e:a4:ee:03"/>
Nov 16 18:01:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:01:02 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:01:02 user nova-compute[75342]:       <target dev="tap7eb0e0f5-10"/>
Nov 16 18:01:02 user nova-compute[75342]:     </interface>
Nov 16 18:01:02 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:01:02 user nova-compute[75342]:       <mac address="fa:16:3e:64:8a:04"/>
Nov 16 18:01:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:01:02 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:01:02 user nova-compute[75342]:       <target dev="tapc3caa036-46"/>
Nov 16 18:01:02 user nova-compute[75342]:     </interface>
Nov 16 18:01:02 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:01:02 user nova-compute[75342]:       <mac address="fa:16:3e:63:5e:99"/>
Nov 16 18:01:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:01:02 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:01:02 user nova-compute[75342]:       <target dev="tap33e085a5-f6"/>
Nov 16 18:01:02 user nova-compute[75342]:     </interface>
Nov 16 18:01:02 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:01:02 user nova-compute[75342]:       <mac address="fa:16:3e:08:ab:71"/>
Nov 16 18:01:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:01:02 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:01:02 user nova-compute[75342]:       <target dev="tap553cae05-4c"/>
Nov 16 18:01:02 user nova-compute[75342]:     </interface>
Nov 16 18:01:02 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:01:02 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/89e3e5a3-2d3c-46d8-b155-3dc429531e00/console.log" append="off"/>
Nov 16 18:01:02 user nova-compute[75342]:     </serial>
Nov 16 18:01:02 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:01:02 user nova-compute[75342]:     <video>
Nov 16 18:01:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:01:02 user nova-compute[75342]:     </video>
Nov 16 18:01:02 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:01:02 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:01:02 user nova-compute[75342]:     </rng>
Nov 16 18:01:02 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:01:02 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:01:02 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:01:02 user nova-compute[75342]:     </memballoon>
Nov 16 18:01:02 user nova-compute[75342]:   </devices>
Nov 16 18:01:02 user nova-compute[75342]: </domain>
Nov 16 18:01:02 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:37:30,bridge_name='br-int',has_traffic_filtering=True,id=ff4eefd7-eda6-4556-b56b-12636302e052,network=Network(e1b81a93-3621-4c71-ad60-d2616fcaa07d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff4eefd7-ed') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:37:30,bridge_name='br-int',has_traffic_filtering=True,id=ff4eefd7-eda6-4556-b56b-12636302e052,network=Network(e1b81a93-3621-4c71-ad60-d2616fcaa07d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff4eefd7-ed') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e015c56a-ed2c-5d66-bf84-8a372191d3a5', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff4eefd7-ed, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff4eefd7-ed, col_values=(('qos', UUID('174b82bb-6fe7-4dca-8285-9581c5c7350a')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff4eefd7-ed, col_values=(('external_ids', {'iface-id': 'ff4eefd7-eda6-4556-b56b-12636302e052', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:37:30', 'vm-uuid': '89e3e5a3-2d3c-46d8-b155-3dc429531e00'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: INFO os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:37:30,bridge_name='br-int',has_traffic_filtering=True,id=ff4eefd7-eda6-4556-b56b-12636302e052,network=Network(e1b81a93-3621-4c71-ad60-d2616fcaa07d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff4eefd7-ed')
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=6af300a9-e32e-4005-bcc0-25cf02d3d478,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af300a9-e3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=6af300a9-e32e-4005-bcc0-25cf02d3d478,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af300a9-e3') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27724e33-fa11-5a45-9980-11e514279901', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6af300a9-e3, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6af300a9-e3, col_values=(('qos', UUID('7563655b-1629-4342-a9b9-a8c1232001e9')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6af300a9-e3, col_values=(('external_ids', {'iface-id': '6af300a9-e32e-4005-bcc0-25cf02d3d478', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:c0:d0', 'vm-uuid': '89e3e5a3-2d3c-46d8-b155-3dc429531e00'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-717a8d14-fce2-488e-9f3e-f1fae701865c req-20ef2802-03eb-4eb1-8794-182c724bf818 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-113082fe-16a5-4f84-9632-ea793bef528a {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-717a8d14-fce2-488e-9f3e-f1fae701865c req-20ef2802-03eb-4eb1-8794-182c724bf818 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-717a8d14-fce2-488e-9f3e-f1fae701865c req-20ef2802-03eb-4eb1-8794-182c724bf818 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-717a8d14-fce2-488e-9f3e-f1fae701865c req-20ef2802-03eb-4eb1-8794-182c724bf818 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-717a8d14-fce2-488e-9f3e-f1fae701865c req-20ef2802-03eb-4eb1-8794-182c724bf818 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-113082fe-16a5-4f84-9632-ea793bef528a {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:02 user nova-compute[75342]: WARNING nova.compute.manager [req-717a8d14-fce2-488e-9f3e-f1fae701865c req-20ef2802-03eb-4eb1-8794-182c724bf818 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-113082fe-16a5-4f84-9632-ea793bef528a for instance with vm_state building and task_state spawning.
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: INFO os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=6af300a9-e32e-4005-bcc0-25cf02d3d478,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af300a9-e3')
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a6:c5,bridge_name='br-int',has_traffic_filtering=True,id=c58d7330-f3b0-4fe2-8f24-687f27f94b1b,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc58d7330-f3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a6:c5,bridge_name='br-int',has_traffic_filtering=True,id=c58d7330-f3b0-4fe2-8f24-687f27f94b1b,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc58d7330-f3') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdfb1b99-070a-5f02-b3e0-0ed5b33a32b3', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc58d7330-f3, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc58d7330-f3, col_values=(('qos', UUID('1ce80b42-3f51-4732-9ad2-9efddcb49bf0')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc58d7330-f3, col_values=(('external_ids', {'iface-id': 'c58d7330-f3b0-4fe2-8f24-687f27f94b1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:a6:c5', 'vm-uuid': '89e3e5a3-2d3c-46d8-b155-3dc429531e00'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-e7e583ab-f0d2-4bcb-8a03-1d7f3957ffcb req-977cf8fc-cfd7-4cef-ab8d-85edefd9b245 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7e583ab-f0d2-4bcb-8a03-1d7f3957ffcb req-977cf8fc-cfd7-4cef-ab8d-85edefd9b245 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7e583ab-f0d2-4bcb-8a03-1d7f3957ffcb req-977cf8fc-cfd7-4cef-ab8d-85edefd9b245 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7e583ab-f0d2-4bcb-8a03-1d7f3957ffcb req-977cf8fc-cfd7-4cef-ab8d-85edefd9b245 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-e7e583ab-f0d2-4bcb-8a03-1d7f3957ffcb req-977cf8fc-cfd7-4cef-ab8d-85edefd9b245 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:03 user nova-compute[75342]: WARNING nova.compute.manager [req-e7e583ab-f0d2-4bcb-8a03-1d7f3957ffcb req-977cf8fc-cfd7-4cef-ab8d-85edefd9b245 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 for instance with vm_state building and task_state spawning.
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: INFO os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a6:c5,bridge_name='br-int',has_traffic_filtering=True,id=c58d7330-f3b0-4fe2-8f24-687f27f94b1b,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc58d7330-f3')
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ee:03,bridge_name='br-int',has_traffic_filtering=True,id=7eb0e0f5-10e0-47fa-85db-40177eec8aed,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb0e0f5-10') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ee:03,bridge_name='br-int',has_traffic_filtering=True,id=7eb0e0f5-10e0-47fa-85db-40177eec8aed,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb0e0f5-10') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82a8e4bb-47cd-5536-8a4d-cef159121f08', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7eb0e0f5-10, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7eb0e0f5-10, col_values=(('qos', UUID('e7dca451-84c2-4500-add1-6194134362bf')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7eb0e0f5-10, col_values=(('external_ids', {'iface-id': '7eb0e0f5-10e0-47fa-85db-40177eec8aed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:ee:03', 'vm-uuid': '89e3e5a3-2d3c-46d8-b155-3dc429531e00'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: INFO os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ee:03,bridge_name='br-int',has_traffic_filtering=True,id=7eb0e0f5-10e0-47fa-85db-40177eec8aed,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb0e0f5-10')
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:8a:04,bridge_name='br-int',has_traffic_filtering=True,id=c3caa036-462f-4be2-b871-21063f9391e6,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3caa036-46') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8a:04,bridge_name='br-int',has_traffic_filtering=True,id=c3caa036-462f-4be2-b871-21063f9391e6,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3caa036-46') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11afe46c-79e1-59c6-966e-394b5ec1a83c', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3caa036-46, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3caa036-46, col_values=(('qos', UUID('c33c6e00-4633-4f71-8d73-8b7907096c1d')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3caa036-46, col_values=(('external_ids', {'iface-id': 'c3caa036-462f-4be2-b871-21063f9391e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:8a:04', 'vm-uuid': '89e3e5a3-2d3c-46d8-b155-3dc429531e00'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: INFO os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8a:04,bridge_name='br-int',has_traffic_filtering=True,id=c3caa036-462f-4be2-b871-21063f9391e6,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3caa036-46')
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:5e:99,bridge_name='br-int',has_traffic_filtering=True,id=33e085a5-f694-4271-8ac1-76b32841c773,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e085a5-f6') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:5e:99,bridge_name='br-int',has_traffic_filtering=True,id=33e085a5-f694-4271-8ac1-76b32841c773,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e085a5-f6') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '564fb4cc-fe1f-59b2-88d1-d7746b672754', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33e085a5-f6, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33e085a5-f6, col_values=(('qos', UUID('1ec9cc6d-56e0-4358-a019-c311f6e9664f')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33e085a5-f6, col_values=(('external_ids', {'iface-id': '33e085a5-f694-4271-8ac1-76b32841c773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:5e:99', 'vm-uuid': '89e3e5a3-2d3c-46d8-b155-3dc429531e00'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: INFO os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:5e:99,bridge_name='br-int',has_traffic_filtering=True,id=33e085a5-f694-4271-8ac1-76b32841c773,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e085a5-f6')
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=553cae05-4cfc-4ddb-b0a4-10440f8d02c2,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553cae05-4c') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=553cae05-4cfc-4ddb-b0a4-10440f8d02c2,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553cae05-4c') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3836c8ea-bbb4-5f85-a56a-583c729a32f4', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap553cae05-4c, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap553cae05-4c, col_values=(('qos', UUID('0fd53b61-5793-43d7-aeb1-e5fd4ab31ac4')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap553cae05-4c, col_values=(('external_ids', {'iface-id': '553cae05-4cfc-4ddb-b0a4-10440f8d02c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:ab:71', 'vm-uuid': '89e3e5a3-2d3c-46d8-b155-3dc429531e00'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: INFO os_vif [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=553cae05-4cfc-4ddb-b0a4-10440f8d02c2,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553cae05-4c')
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] No BDM found with device name hda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] No VIF found with MAC fa:16:3e:33:37:30, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] No VIF found with MAC fa:16:3e:64:8a:04, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:01:04 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Using config drive
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:04 user nova-compute[75342]: WARNING nova.compute.manager [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 for instance with vm_state building and task_state spawning.
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:04 user nova-compute[75342]: WARNING nova.compute.manager [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-76cba993-b3d2-4572-9717-ed57282839e3 for instance with vm_state building and task_state spawning.
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:04 user nova-compute[75342]: WARNING nova.compute.manager [req-b3fe1968-9039-42b0-a079-0128df9c8cce req-b5be3651-d8b6-4b08-b7e7-dde8cc38260a service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-76cba993-b3d2-4572-9717-ed57282839e3 for instance with vm_state building and task_state spawning.
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Creating config drive at /opt/stack/data/nova/instances/89e3e5a3-2d3c-46d8-b155-3dc429531e00/disk.config
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/89e3e5a3-2d3c-46d8-b155-3dc429531e00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxds86jwu {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/89e3e5a3-2d3c-46d8-b155-3dc429531e00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxds86jwu" returned: 0 in 0.053s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-113082fe-16a5-4f84-9632-ea793bef528a {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-113082fe-16a5-4f84-9632-ea793bef528a {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:04 user nova-compute[75342]: WARNING nova.compute.manager [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-113082fe-16a5-4f84-9632-ea793bef528a for instance with vm_state building and task_state spawning.
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:04 user nova-compute[75342]: WARNING nova.compute.manager [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-0c243b55-8e7b-406e-8404-da8441b7d178 for instance with vm_state building and task_state spawning.
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:04 user nova-compute[75342]: WARNING nova.compute.manager [req-06d43d6a-d354-4806-add0-4647a92ad52d req-e052c2f8-d8a0-4bae-937b-d4804befb9c7 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-0c243b55-8e7b-406e-8404-da8441b7d178 for instance with vm_state building and task_state spawning.
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:05 user nova-compute[75342]: WARNING nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 for instance with vm_state building and task_state spawning.
Nov 16 18:01:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:05 user nova-compute[75342]: WARNING nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-525600ed-9b60-41f1-b353-65ca202dbb85 for instance with vm_state building and task_state spawning.
Nov 16 18:01:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:05 user nova-compute[75342]: WARNING nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-525600ed-9b60-41f1-b353-65ca202dbb85 for instance with vm_state building and task_state spawning.
Nov 16 18:01:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:05 user nova-compute[75342]: WARNING nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 for instance with vm_state building and task_state spawning.
Nov 16 18:01:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:05 user nova-compute[75342]: WARNING nova.compute.manager [req-590382cb-16d8-460e-99b9-0a1ab01162d8 req-7f9136ef-7f52-49ca-ac21-03a7c579c3b1 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 for instance with vm_state building and task_state spawning.
Nov 16 18:01:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:01:06 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Instance spawned successfully.
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:06 user nova-compute[75342]: INFO nova.compute.manager [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Took 12.36 seconds to spawn the instance on the hypervisor.
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:06 user nova-compute[75342]: INFO nova.compute.manager [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Took 32.53 seconds to build instance.
Nov 16 18:01:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-98a98ed0-9616-4906-8f9b-76dbc7170501 tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.825s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:06 user nova-compute[75342]: WARNING nova.compute.manager [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-ff4eefd7-eda6-4556-b56b-12636302e052 for instance with vm_state building and task_state spawning.
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:06 user nova-compute[75342]: WARNING nova.compute.manager [req-98405759-ab1e-4ad9-b88a-d600dd09dc83 req-be09fa83-0015-41bc-b75c-7f9ad6cd44c9 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-ff4eefd7-eda6-4556-b56b-12636302e052 for instance with vm_state building and task_state spawning.
Nov 16 18:01:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:07 user nova-compute[75342]: WARNING nova.compute.manager [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 for instance with vm_state building and task_state spawning.
Nov 16 18:01:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:07 user nova-compute[75342]: WARNING nova.compute.manager [req-b5a80900-8627-4871-88b1-26ec75426f8c req-df400f74-d424-4483-9a56-f5acabe81b2e service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 for instance with vm_state building and task_state spawning.
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-9e60e4e1-a6e0-4dfb-994b-0333918c7db2 req-d62f0011-5711-49c1-b9de-1f4b9e68b4ec service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9e60e4e1-a6e0-4dfb-994b-0333918c7db2 req-d62f0011-5711-49c1-b9de-1f4b9e68b4ec service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9e60e4e1-a6e0-4dfb-994b-0333918c7db2 req-d62f0011-5711-49c1-b9de-1f4b9e68b4ec service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9e60e4e1-a6e0-4dfb-994b-0333918c7db2 req-d62f0011-5711-49c1-b9de-1f4b9e68b4ec service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-9e60e4e1-a6e0-4dfb-994b-0333918c7db2 req-d62f0011-5711-49c1-b9de-1f4b9e68b4ec service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:07 user nova-compute[75342]: WARNING nova.compute.manager [req-9e60e4e1-a6e0-4dfb-994b-0333918c7db2 req-d62f0011-5711-49c1-b9de-1f4b9e68b4ec service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed for instance with vm_state building and task_state spawning.
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:08 user nova-compute[75342]: WARNING nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b for instance with vm_state building and task_state spawning.
Nov 16 18:01:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:08 user nova-compute[75342]: WARNING nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b for instance with vm_state building and task_state spawning.
Nov 16 18:01:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:08 user nova-compute[75342]: WARNING nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-33e085a5-f694-4271-8ac1-76b32841c773 for instance with vm_state building and task_state spawning.
Nov 16 18:01:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:09 user nova-compute[75342]: WARNING nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-33e085a5-f694-4271-8ac1-76b32841c773 for instance with vm_state building and task_state spawning.
Nov 16 18:01:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:09 user nova-compute[75342]: WARNING nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 for instance with vm_state building and task_state spawning.
Nov 16 18:01:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:09 user nova-compute[75342]: WARNING nova.compute.manager [req-78301e2b-ca3d-4726-a683-b181313efea6 req-99f56d72-58e7-428f-bbdd-5ad555d1b026 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 for instance with vm_state building and task_state spawning.
Nov 16 18:01:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:09 user nova-compute[75342]: WARNING nova.compute.manager [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed for instance with vm_state building and task_state spawning.
Nov 16 18:01:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:09 user nova-compute[75342]: WARNING nova.compute.manager [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-c3caa036-462f-4be2-b871-21063f9391e6 for instance with vm_state building and task_state spawning.
Nov 16 18:01:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:09 user nova-compute[75342]: WARNING nova.compute.manager [req-2f4dcb54-9821-4ff1-a78c-a7f378979d14 req-72e2dd7f-1127-411a-9a65-bd2eaee3099c service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-c3caa036-462f-4be2-b871-21063f9391e6 for instance with vm_state building and task_state spawning.
Nov 16 18:01:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:01:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:01:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Instance spawned successfully.
Nov 16 18:01:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:01:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:01:10 user nova-compute[75342]: INFO nova.compute.manager [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Took 14.27 seconds to spawn the instance on the hypervisor.
Nov 16 18:01:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:01:10 user nova-compute[75342]: INFO nova.compute.manager [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Took 33.14 seconds to build instance.
Nov 16 18:01:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ce0afa92-e72a-458f-840d-c530ee2d3632 tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.324s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:01:27 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:01:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:28 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:01:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:29 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-d298b476-e0d4-4142-993d-c32c237de770 req-6609ded0-4526-4c18-824e-cdd878cfa072 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received event network-changed-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-d298b476-e0d4-4142-993d-c32c237de770 req-6609ded0-4526-4c18-824e-cdd878cfa072 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Refreshing instance network info cache due to event network-changed-90788e52-2039-4374-bf9a-a77637f0752d. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d298b476-e0d4-4142-993d-c32c237de770 req-6609ded0-4526-4c18-824e-cdd878cfa072 service nova] Acquiring lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d298b476-e0d4-4142-993d-c32c237de770 req-6609ded0-4526-4c18-824e-cdd878cfa072 service nova] Acquired lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG nova.network.neutron [req-d298b476-e0d4-4142-993d-c32c237de770 req-6609ded0-4526-4c18-824e-cdd878cfa072 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Refreshing network info cache for port 90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json" returned: 0 in 0.415s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG nova.network.neutron [req-d298b476-e0d4-4142-993d-c32c237de770 req-6609ded0-4526-4c18-824e-cdd878cfa072 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updated VIF entry in instance network info cache for port 90788e52-2039-4374-bf9a-a77637f0752d. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG nova.network.neutron [req-d298b476-e0d4-4142-993d-c32c237de770 req-6609ded0-4526-4c18-824e-cdd878cfa072 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updating instance_info_cache with network_info: [{"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d298b476-e0d4-4142-993d-c32c237de770 req-6609ded0-4526-4c18-824e-cdd878cfa072 service nova] Releasing lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:01:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:35 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:01:35 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=6657MB free_disk=25.547046661376953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lazy-loading 'flavor' on Instance uuid 35052d56-cec1-4a07-84f4-a6f5b65bb9bd {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 35052d56-cec1-4a07-84f4-a6f5b65bb9bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 2992b5fc-86e6-425f-82e5-cf6358582872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance e00c5b4b-e155-4513-bda3-7eea536e8742 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance a04eb165-88b6-4826-a4ac-c1bc51a57ba5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 07c92356-fdd3-4884-b406-55c92c63db18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 65e77fb1-8148-46a5-bc53-139b7ea096ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d057c823-fd25-45f9-ba3e-11a784f38064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 77a26e02-f97e-4911-9dd4-3f6f30d92edc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 89e3e5a3-2d3c-46d8-b155-3dc429531e00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:36 user nova-compute[75342]: INFO nova.compute.manager [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Attaching volume 44ce4ee9-0631-46b1-8ecb-c0f6437b70df to /dev/vdb
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG os_brick.utils [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e028547b-3d74-41ea-a8dc-d16489023e8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df9f303-5c9f-49e6-b9f6-3a14b5925dcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:36 user nova-compute[75342]: INFO nova.compute.manager [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] instance snapshotting
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a044e-f3b2-4948-9124-a44a68e1dc6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bad8a4-4b41-44db-9a4d-fa5f889de858]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:01:36 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[34447f3e-a2a1-4abd-be70-53cbeb772c5f]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG os_brick.utils [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Updating existing volume attachment record: aabe212b-c76d-43ef-b5c2-1901c90cec3b {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:01:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Beginning live snapshot process
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json -f qcow2 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json -f qcow2 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.166s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv2lr0qgh/abcf77f00a06401b893e3760645558cb.delta 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv2lr0qgh/abcf77f00a06401b893e3760645558cb.delta 1073741824" returned: 0 in 0.050s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:37 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 18:01:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75342) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 16 18:01:37 user nova-compute[75342]: INFO nova.virt.libvirt.host [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] UEFI support detected
Nov 16 18:01:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:01:37 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:01:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-35052d56-cec1-4a07-84f4-a6f5b65bb9bd" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:01:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-35052d56-cec1-4a07-84f4-a6f5b65bb9bd" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:01:37 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:01:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:01:38 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Updating instance_info_cache with network_info: [{"id": "ad751606-e2b6-4e87-8e84-b52e103606ad", "address": "fa:16:3e:70:86:1d", "network": {"id": "2e3be18f-3a5d-476c-95cf-2b04ce1bee1f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-858330362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be58a244a17c414fb222d6ed5d3a5c87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad751606-e2", "ovs_interfaceid": "ad751606-e2b6-4e87-8e84-b52e103606ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:01:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-35052d56-cec1-4a07-84f4-a6f5b65bb9bd" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:01:38 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:01:38 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:01:38 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:01:38 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:01:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:01:38 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 18:01:38 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:01:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv2lr0qgh/abcf77f00a06401b893e3760645558cb.delta /opt/stack/data/nova/instances/snapshots/tmpv2lr0qgh/abcf77f00a06401b893e3760645558cb {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv2lr0qgh/abcf77f00a06401b893e3760645558cb.delta /opt/stack/data/nova/instances/snapshots/tmpv2lr0qgh/abcf77f00a06401b893e3760645558cb" returned: 0 in 0.432s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Snapshot extracted, beginning image upload
Nov 16 18:01:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:40 user nova-compute[75342]: DEBUG nova.compute.manager [req-1b5b27dd-4ca1-452d-90bf-a1b8deca5746 req-9c85eaae-ddf6-4ced-8512-32380b64252c service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-changed-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:40 user nova-compute[75342]: DEBUG nova.compute.manager [req-1b5b27dd-4ca1-452d-90bf-a1b8deca5746 req-9c85eaae-ddf6-4ced-8512-32380b64252c service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Refreshing instance network info cache due to event network-changed-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:01:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1b5b27dd-4ca1-452d-90bf-a1b8deca5746 req-9c85eaae-ddf6-4ced-8512-32380b64252c service nova] Acquiring lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:01:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1b5b27dd-4ca1-452d-90bf-a1b8deca5746 req-9c85eaae-ddf6-4ced-8512-32380b64252c service nova] Acquired lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:01:40 user nova-compute[75342]: DEBUG nova.network.neutron [req-1b5b27dd-4ca1-452d-90bf-a1b8deca5746 req-9c85eaae-ddf6-4ced-8512-32380b64252c service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Refreshing network info cache for port b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:01:41 user nova-compute[75342]: DEBUG nova.network.neutron [req-1b5b27dd-4ca1-452d-90bf-a1b8deca5746 req-9c85eaae-ddf6-4ced-8512-32380b64252c service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updated VIF entry in instance network info cache for port b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:01:41 user nova-compute[75342]: DEBUG nova.network.neutron [req-1b5b27dd-4ca1-452d-90bf-a1b8deca5746 req-9c85eaae-ddf6-4ced-8512-32380b64252c service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating instance_info_cache with network_info: [{"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:01:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1b5b27dd-4ca1-452d-90bf-a1b8deca5746 req-9c85eaae-ddf6-4ced-8512-32380b64252c service nova] Releasing lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:01:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:01:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEGVmfQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:01:41 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:01:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:01:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:01:41 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:01:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:01:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:01:41 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:01:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f306af97-fe7e-4f96-9fa7-14b9af7b835e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:01:41 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[113cf0dd-ceae-4037-a836-20d4e65012ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df] added
Nov 16 18:01:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dc7123-84c7-43de-a6db-3ded9b3107f8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1f6026-51b0-4f91-8acc-2270772c9d4b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEGVmfQk {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Snapshot image upload complete
Nov 16 18:01:42 user nova-compute[75342]: INFO nova.compute.manager [None req-1f34414d-0b27-44d3-8ae2-6ae6c94a04e4 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Took 5.72 seconds to snapshot the instance on the hypervisor.
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEGVmfQk" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68874f9-47c3-4018-a990-09743897e578]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gEGVmfQk'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[52821ed4-4f42-467e-91a6-c53c00d80631]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf6e819-e4cd-45ad-8f97-c8d7f06bc3d6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65e8ece-8a3c-4de2-9266-005b4885100d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df, portal: 172.16.0.220,3260]
Nov 16 18:01:42 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df, portal: 172.16.0.220,3260] successful.
Nov 16 18:01:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[642ecfbe-be7a-437f-89d6-96f9ba8d1f3c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[df13b0e4-48e5-49b7-a0e0-2b703e9360ad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df (non-flash)
Nov 16 18:01:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:42 user nova-compute[75342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df (non-flash)
Nov 16 18:01:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b3cd46-c236-4e19-9f97-44006a25421b]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEGVmfQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:01:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:01:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23335643263363331', 'path': '/dev/sdi'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:01:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335643263363331', 'path': '/dev/sdi'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:01:43 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lazy-loading 'flavor' on Instance uuid 35052d56-cec1-4a07-84f4-a6f5b65bb9bd {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:01:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:01:43 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:01:43 user nova-compute[75342]:   <source dev="/dev/sdi"/>
Nov 16 18:01:43 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:01:43 user nova-compute[75342]:   <serial>44ce4ee9-0631-46b1-8ecb-c0f6437b70df</serial>
Nov 16 18:01:43 user nova-compute[75342]: </disk>
Nov 16 18:01:43 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:01:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:01:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:01:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] No VIF found with MAC fa:16:3e:70:86:1d, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:01:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8c4eb0ae-309b-45f5-b524-05ed6b23d6a6 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.773s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:45 user nova-compute[75342]: INFO nova.compute.manager [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Terminating instance
Nov 16 18:01:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-d0053f3d-ffdd-461d-8714-1b1f1eac2f44 req-b04ca29b-8c03-47d0-992f-c94fd076e151 service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Received event network-vif-unplugged-ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d0053f3d-ffdd-461d-8714-1b1f1eac2f44 req-b04ca29b-8c03-47d0-992f-c94fd076e151 service nova] Acquiring lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d0053f3d-ffdd-461d-8714-1b1f1eac2f44 req-b04ca29b-8c03-47d0-992f-c94fd076e151 service nova] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d0053f3d-ffdd-461d-8714-1b1f1eac2f44 req-b04ca29b-8c03-47d0-992f-c94fd076e151 service nova] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-d0053f3d-ffdd-461d-8714-1b1f1eac2f44 req-b04ca29b-8c03-47d0-992f-c94fd076e151 service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] No waiting events found dispatching network-vif-unplugged-ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-d0053f3d-ffdd-461d-8714-1b1f1eac2f44 req-b04ca29b-8c03-47d0-992f-c94fd076e151 service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Received event network-vif-unplugged-ad751606-e2b6-4e87-8e84-b52e103606ad for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:45 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Instance destroyed successfully.
Nov 16 18:01:45 user nova-compute[75342]: DEBUG nova.objects.instance [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lazy-loading 'resources' on Instance uuid 35052d56-cec1-4a07-84f4-a6f5b65bb9bd {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-371218078',display_name='tempest-DeleteServersTestJSON-server-371218078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-371218078',id=2,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be58a244a17c414fb222d6ed5d3a5c87',ramdisk_id='',reservation_id='r-fmho2hb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-51749853',owner_user_name='tempest-DeleteServersTestJSON-51749853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:00:02Z,user_data=None,user_id='243fe22891ae486fa79d3aeb79c9af99',uuid=35052d56-cec1-4a07-84f4-a6f5b65bb9bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad751606-e2b6-4e87-8e84-b52e103606ad", "address": "fa:16:3e:70:86:1d", "network": {"id": "2e3be18f-3a5d-476c-95cf-2b04ce1bee1f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-858330362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be58a244a17c414fb222d6ed5d3a5c87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad751606-e2", "ovs_interfaceid": "ad751606-e2b6-4e87-8e84-b52e103606ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Converting VIF {"id": "ad751606-e2b6-4e87-8e84-b52e103606ad", "address": "fa:16:3e:70:86:1d", "network": {"id": "2e3be18f-3a5d-476c-95cf-2b04ce1bee1f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-858330362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be58a244a17c414fb222d6ed5d3a5c87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad751606-e2", "ovs_interfaceid": "ad751606-e2b6-4e87-8e84-b52e103606ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:86:1d,bridge_name='br-int',has_traffic_filtering=True,id=ad751606-e2b6-4e87-8e84-b52e103606ad,network=Network(2e3be18f-3a5d-476c-95cf-2b04ce1bee1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad751606-e2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG os_vif [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:86:1d,bridge_name='br-int',has_traffic_filtering=True,id=ad751606-e2b6-4e87-8e84-b52e103606ad,network=Network(2e3be18f-3a5d-476c-95cf-2b04ce1bee1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad751606-e2') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad751606-e2, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95499f64-0991-433b-bb59-7af1f8dc7814) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:45 user nova-compute[75342]: INFO os_vif [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:86:1d,bridge_name='br-int',has_traffic_filtering=True,id=ad751606-e2b6-4e87-8e84-b52e103606ad,network=Network(2e3be18f-3a5d-476c-95cf-2b04ce1bee1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad751606-e2')
Nov 16 18:01:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEGVmfQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:01:45 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:01:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:01:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfca433-d4a4-4115-8ecf-d938ba3bcb4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:01:46 user nova-compute[75342]: No targets found.
Nov 16 18:01:46 user nova-compute[75342]: iSNS:
Nov 16 18:01:46 user nova-compute[75342]: No targets found.
Nov 16 18:01:46 user nova-compute[75342]: STATIC:
Nov 16 18:01:46 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19
Nov 16 18:01:46 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:01:46 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:01:46 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:01:46 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:01:46 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:01:46 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa
Nov 16 18:01:46 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:01:46 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:01:46 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df
Nov 16 18:01:46 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:01:46 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:01:46 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b
Nov 16 18:01:46 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:01:46 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:01:46 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c
Nov 16 18:01:46 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:01:46 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:01:46 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584
Nov 16 18:01:46 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:01:46 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:01:46 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea
Nov 16 18:01:46 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:01:46 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:01:46 user nova-compute[75342]: FIRMWARE:
Nov 16 18:01:46 user nova-compute[75342]: No targets found.
Nov 16 18:01:46 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:01:46 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:01:46 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[faebce9c-bd13-47e4-8fba-03b35b31892b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f178cbb-a40d-4125-ba75-6d4cda9ad5e8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df (non-flash)
Nov 16 18:01:46 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:46 user nova-compute[75342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df (non-flash)
Nov 16 18:01:46 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c85595a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df'): ({'sdi'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Removing single pathed devices sdi {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3481f7c-a0c8-4e6d-bcdb-b6031916f323]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f9234b-957f-40dc-a622-ccbcc453ad2e]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Flushing IO for device /dev/sdi {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.011s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa53a68f-0cee-49f7-b116-6e886b6a5d75]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4968e0-c3dc-47dd-915e-3fc238d8d2ce]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] SCSI volumes sdi have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c246290a-e001-4720-994b-a7776abed3d1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1201c25-dea1-4099-af18-a89527f5867e]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df, portal: 172.16.0.220,3260]
Nov 16 18:01:46 user nova-compute[75342]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df, portal: 172.16.0.220,3260] successful.
Nov 16 18:01:46 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce4ee9-0631-46b1-8ecb-c0f6437b70df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06e867d-4bee-4f84-a9c1-0645b7709a04]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] <== disconnect_volume: return (320ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:01:46 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Deleting instance files /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd_del
Nov 16 18:01:46 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Deletion of /opt/stack/data/nova/instances/35052d56-cec1-4a07-84f4-a6f5b65bb9bd_del complete
Nov 16 18:01:46 user nova-compute[75342]: INFO nova.compute.manager [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 16 18:01:46 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:01:46 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:01:46 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Took 0.48 seconds to deallocate network for instance.
Nov 16 18:01:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-90ac6a1a-6868-464b-977c-36dff9e3abc3 req-de49ec9c-9361-48f8-ad81-82e1a8a5822c service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Received event network-vif-deleted-ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-664ba8c2-fcd6-4189-b1db-7b3dfc0c6915 req-6b619363-f3a5-4c77-bc30-0f6cbc2ecebc service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Received event network-vif-plugged-ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-664ba8c2-fcd6-4189-b1db-7b3dfc0c6915 req-6b619363-f3a5-4c77-bc30-0f6cbc2ecebc service nova] Acquiring lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-664ba8c2-fcd6-4189-b1db-7b3dfc0c6915 req-6b619363-f3a5-4c77-bc30-0f6cbc2ecebc service nova] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-664ba8c2-fcd6-4189-b1db-7b3dfc0c6915 req-6b619363-f3a5-4c77-bc30-0f6cbc2ecebc service nova] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-664ba8c2-fcd6-4189-b1db-7b3dfc0c6915 req-6b619363-f3a5-4c77-bc30-0f6cbc2ecebc service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] No waiting events found dispatching network-vif-plugged-ad751606-e2b6-4e87-8e84-b52e103606ad {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:01:47 user nova-compute[75342]: WARNING nova.compute.manager [req-664ba8c2-fcd6-4189-b1db-7b3dfc0c6915 req-6b619363-f3a5-4c77-bc30-0f6cbc2ecebc service nova] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Received unexpected event network-vif-plugged-ad751606-e2b6-4e87-8e84-b52e103606ad for instance with vm_state active and task_state deleting.
Nov 16 18:01:47 user nova-compute[75342]: INFO nova.compute.manager [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] [instance: 35052d56-cec1-4a07-84f4-a6f5b65bb9bd] Took 0.77 seconds to detach 1 volumes for instance.
Nov 16 18:01:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:48 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:01:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:01:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:48 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Deleted allocations for instance 35052d56-cec1-4a07-84f4-a6f5b65bb9bd
Nov 16 18:01:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-cc8dc228-a9cf-4834-a60f-506feff23ad2 tempest-DeleteServersTestJSON-51749853 tempest-DeleteServersTestJSON-51749853-project-member] Lock "35052d56-cec1-4a07-84f4-a6f5b65bb9bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.057s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-53a1b774-0fa8-4fb6-96b3-d8dfd25e0049 req-54a059d4-fa6a-42d8-89de-275900f0c079 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Received event network-changed-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-53a1b774-0fa8-4fb6-96b3-d8dfd25e0049 req-54a059d4-fa6a-42d8-89de-275900f0c079 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Refreshing instance network info cache due to event network-changed-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:01:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-53a1b774-0fa8-4fb6-96b3-d8dfd25e0049 req-54a059d4-fa6a-42d8-89de-275900f0c079 service nova] Acquiring lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:01:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-53a1b774-0fa8-4fb6-96b3-d8dfd25e0049 req-54a059d4-fa6a-42d8-89de-275900f0c079 service nova] Acquired lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:01:49 user nova-compute[75342]: DEBUG nova.network.neutron [req-53a1b774-0fa8-4fb6-96b3-d8dfd25e0049 req-54a059d4-fa6a-42d8-89de-275900f0c079 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Refreshing network info cache for port 8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:01:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:49 user nova-compute[75342]: DEBUG nova.objects.instance [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lazy-loading 'flavor' on Instance uuid edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:01:49 user nova-compute[75342]: DEBUG nova.network.neutron [req-53a1b774-0fa8-4fb6-96b3-d8dfd25e0049 req-54a059d4-fa6a-42d8-89de-275900f0c079 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Updated VIF entry in instance network info cache for port 8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:01:49 user nova-compute[75342]: DEBUG nova.network.neutron [req-53a1b774-0fa8-4fb6-96b3-d8dfd25e0049 req-54a059d4-fa6a-42d8-89de-275900f0c079 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Updating instance_info_cache with network_info: [{"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:01:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-53a1b774-0fa8-4fb6-96b3-d8dfd25e0049 req-54a059d4-fa6a-42d8-89de-275900f0c079 service nova] Releasing lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:50 user nova-compute[75342]: INFO nova.compute.manager [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Attaching volume e544b55c-dc09-4117-aa3a-26c60bac06a9 to /dev/vdb
Nov 16 18:01:50 user nova-compute[75342]: DEBUG os_brick.utils [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37262f8-2de3-4516-b9e4-9705406e6419]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[26727887-180c-4a57-9d8b-75048f3d7bcc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b81b929-0473-41ff-937b-d72637ca28c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b52c67-48ae-4dd7-8fc8-5ff006ec87c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:01:50 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:01:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af3fc22-f8a5-49f0-a354-540918613bb1]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG os_brick.utils [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Updating existing volume attachment record: b830010c-426f-42c1-a170-9b714c8ee9f4 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:01:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-0e7b6468-f0cb-4ca6-91a4-471563424061 req-639c2a80-26c7-4814-a058-e1f1bd8b598d service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Received event network-changed-ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:01:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-0e7b6468-f0cb-4ca6-91a4-471563424061 req-639c2a80-26c7-4814-a058-e1f1bd8b598d service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Refreshing instance network info cache due to event network-changed-ebf8ff34-740f-4344-9caf-aec4d0b51afc. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:01:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0e7b6468-f0cb-4ca6-91a4-471563424061 req-639c2a80-26c7-4814-a058-e1f1bd8b598d service nova] Acquiring lock "refresh_cache-e00c5b4b-e155-4513-bda3-7eea536e8742" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:01:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0e7b6468-f0cb-4ca6-91a4-471563424061 req-639c2a80-26c7-4814-a058-e1f1bd8b598d service nova] Acquired lock "refresh_cache-e00c5b4b-e155-4513-bda3-7eea536e8742" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:01:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-0e7b6468-f0cb-4ca6-91a4-471563424061 req-639c2a80-26c7-4814-a058-e1f1bd8b598d service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Refreshing network info cache for port ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:01:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-0e7b6468-f0cb-4ca6-91a4-471563424061 req-639c2a80-26c7-4814-a058-e1f1bd8b598d service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Updated VIF entry in instance network info cache for port ebf8ff34-740f-4344-9caf-aec4d0b51afc. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:01:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-0e7b6468-f0cb-4ca6-91a4-471563424061 req-639c2a80-26c7-4814-a058-e1f1bd8b598d service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Updating instance_info_cache with network_info: [{"id": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "address": "fa:16:3e:4a:0c:36", "network": {"id": "bf70d248-3de6-4375-85f0-c7b29d766fc1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1928035521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84123b277d334ce38d98292f7178eea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf8ff34-74", "ovs_interfaceid": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:01:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0e7b6468-f0cb-4ca6-91a4-471563424061 req-639c2a80-26c7-4814-a058-e1f1bd8b598d service nova] Releasing lock "refresh_cache-e00c5b4b-e155-4513-bda3-7eea536e8742" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:01:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "e00c5b4b-e155-4513-bda3-7eea536e8742" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG nova.objects.instance [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lazy-loading 'flavor' on Instance uuid e00c5b4b-e155-4513-bda3-7eea536e8742 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "e00c5b4b-e155-4513-bda3-7eea536e8742" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:54 user nova-compute[75342]: INFO nova.compute.manager [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Attaching volume 537757ae-b43e-4441-8d0e-594d15f1f693 to /dev/sdc
Nov 16 18:01:54 user nova-compute[75342]: DEBUG os_brick.utils [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f33dbb3-defd-4c8b-a47c-7cf269d20ff3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4948c19d-8df3-41d4-98e5-cb5c561b69a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50546c7-55c0-42f8-92c8-0ee25b6d67cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[593d9ab7-f121-4208-b3ab-417d5a7293fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:01:54 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:01:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2084e3-3818-4518-95c3-b6391c224057]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG os_brick.utils [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:01:54 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Updating existing volume attachment record: 93dd1252-8853-4921-a792-53c989e16281 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geQAcXGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:01:55 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:01:55 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:01:55 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[266b087d-80b7-4e00-95ce-b0a00b86867b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:01:55 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfef5900-0611-46ff-a124-b1a031fd8526]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9] added
Nov 16 18:01:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10b29a6-6239-4538-8438-fc8c2b399699]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac6fde5-a8a2-46d1-beb0-0c8163af15d3]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geQAcXGv {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geQAcXGv" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dc8b41-f595-478d-a5b0-468bfd25ba52]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'geQAcXGv'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdfd05d-e78b-4d2b-82b3-af8b5a77c85d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a798cdf-77bc-4075-bc16-b99fa8bf79cb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[252953a4-a85c-40ec-a033-abe215ee4533]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9, portal: 172.16.0.220,3260]
Nov 16 18:01:55 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9, portal: 172.16.0.220,3260] successful.
Nov 16 18:01:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[164acd34-8315-4402-9970-04be3df2c703]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[deddf5f5-cab7-4dbc-b0e8-4e4cd65ab63d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:55 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f754b6-c587-49ef-a02f-5070102ebe2e]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geQAcXGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:01:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:01:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23233346539363337', 'path': '/dev/sdi'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:01:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233346539363337', 'path': '/dev/sdi'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:01:56 user nova-compute[75342]: DEBUG nova.objects.instance [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lazy-loading 'flavor' on Instance uuid edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:01:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:01:56 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:01:56 user nova-compute[75342]:   <source dev="/dev/sdi"/>
Nov 16 18:01:56 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:01:56 user nova-compute[75342]:   <serial>e544b55c-dc09-4117-aa3a-26c60bac06a9</serial>
Nov 16 18:01:56 user nova-compute[75342]: </disk>
Nov 16 18:01:56 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:01:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:01:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:01:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] No VIF found with MAC fa:16:3e:3c:a8:f7, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:01:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e81efa56-a2ba-4c35-8c90-224406d6813e tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.231s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:01:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:01:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:01:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:01:58 user nova-compute[75342]: INFO nova.compute.manager [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Detaching volume e544b55c-dc09-4117-aa3a-26c60bac06a9
Nov 16 18:01:58 user nova-compute[75342]: INFO nova.virt.block_device [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Attempting to driver detach volume e544b55c-dc09-4117-aa3a-26c60bac06a9 from mountpoint /dev/vdb
Nov 16 18:01:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Attempting to detach device vdb from instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:01:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:01:58 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:01:58 user nova-compute[75342]:   <source dev="/dev/sdi"/>
Nov 16 18:01:58 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:01:58 user nova-compute[75342]:   <serial>e544b55c-dc09-4117-aa3a-26c60bac06a9</serial>
Nov 16 18:01:58 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:01:58 user nova-compute[75342]: </disk>
Nov 16 18:01:58 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:01:58 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Successfully detached device vdb from instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 from the persistent domain config.
Nov 16 18:01:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:01:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:01:58 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:01:58 user nova-compute[75342]:   <source dev="/dev/sdi"/>
Nov 16 18:01:58 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:01:58 user nova-compute[75342]:   <serial>e544b55c-dc09-4117-aa3a-26c60bac06a9</serial>
Nov 16 18:01:58 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:01:58 user nova-compute[75342]: </disk>
Nov 16 18:01:58 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:01:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWKAFhgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:01:59 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:01:59 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:01:59 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dde4eb-0731-4863-aed8-27d42ed436b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:01:59 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8d89c0-f379-469e-b2c0-90e2c63ece12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693] added
Nov 16 18:01:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31685f0-51b0-40c6-9fe5-60cfdbbbdb99]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9b970d-9289-4d2c-9932-5e9814c80b1a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWKAFhgB {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWKAFhgB" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[502e1d25-1eab-4ae3-af16-67feee1cdd1c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWKAFhgB'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3676b0-00cd-4eaf-8ac9-1aa61c1402b8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5203b0ee-44a9-405a-bff7-42f41986dfb7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0c935c-ba2e-4b3d-b56c-80c93c4cd116]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693, portal: 172.16.0.220,3260]
Nov 16 18:01:59 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693, portal: 172.16.0.220,3260] successful.
Nov 16 18:01:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[46425042-1f55-47fb-869f-a5f9e4137a74]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b768257a-9dc8-4a9c-986d-07d881482e7a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:01:59 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:01:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2115ddb2-2bf7-4782-8403-5f2fc7c706b9]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:01:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWKAFhgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:02:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23139346334373632', 'path': '/dev/sdj'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139346334373632', 'path': '/dev/sdj'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:02:00 user nova-compute[75342]: DEBUG nova.objects.instance [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lazy-loading 'flavor' on Instance uuid e00c5b4b-e155-4513-bda3-7eea536e8742 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:02:00 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:00 user nova-compute[75342]:   <source dev="/dev/sdj"/>
Nov 16 18:02:00 user nova-compute[75342]:   <target dev="sdc" bus="scsi"/>
Nov 16 18:02:00 user nova-compute[75342]:   <serial>537757ae-b43e-4441-8d0e-594d15f1f693</serial>
Nov 16 18:02:00 user nova-compute[75342]:   <address type="drive" controller="0" unit="2"/>
Nov 16 18:02:00 user nova-compute[75342]: </disk>
Nov 16 18:02:00 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:02:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] No BDM found with device name sda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] No VIF found with MAC fa:16:3e:4a:0c:36, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:02:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-04076f2b-4bdd-4de3-8940-69cef8a1868c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.354s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "e00c5b4b-e155-4513-bda3-7eea536e8742" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:02 user nova-compute[75342]: INFO nova.compute.manager [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Detaching volume 537757ae-b43e-4441-8d0e-594d15f1f693
Nov 16 18:02:02 user nova-compute[75342]: INFO nova.virt.block_device [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Attempting to driver detach volume 537757ae-b43e-4441-8d0e-594d15f1f693 from mountpoint /dev/sdc
Nov 16 18:02:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Attempting to detach device sdc from instance e00c5b4b-e155-4513-bda3-7eea536e8742 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:02:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:02:02 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:02 user nova-compute[75342]:   <source dev="/dev/sdj"/>
Nov 16 18:02:02 user nova-compute[75342]:   <target dev="sdc" bus="scsi"/>
Nov 16 18:02:02 user nova-compute[75342]:   <serial>537757ae-b43e-4441-8d0e-594d15f1f693</serial>
Nov 16 18:02:02 user nova-compute[75342]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 18:02:02 user nova-compute[75342]: </disk>
Nov 16 18:02:02 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:02:02 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Successfully detached device sdc from instance e00c5b4b-e155-4513-bda3-7eea536e8742 from the persistent domain config.
Nov 16 18:02:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e00c5b4b-e155-4513-bda3-7eea536e8742 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:02:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:02:02 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:02 user nova-compute[75342]:   <source dev="/dev/sdj"/>
Nov 16 18:02:02 user nova-compute[75342]:   <target dev="sdc" bus="scsi"/>
Nov 16 18:02:02 user nova-compute[75342]:   <serial>537757ae-b43e-4441-8d0e-594d15f1f693</serial>
Nov 16 18:02:02 user nova-compute[75342]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 18:02:02 user nova-compute[75342]: </disk>
Nov 16 18:02:02 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:02:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e00c5b4b-e155-4513-bda3-7eea536e8742 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:02:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-5b51543e-82db-4487-9061-5cf0ee1c315c req-91732772-b1c9-4ae3-8499-6c970c88f289 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received event network-changed-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-5b51543e-82db-4487-9061-5cf0ee1c315c req-91732772-b1c9-4ae3-8499-6c970c88f289 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Refreshing instance network info cache due to event network-changed-90e051e5-17e8-4b97-92c4-2bd190722aa7. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:02:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5b51543e-82db-4487-9061-5cf0ee1c315c req-91732772-b1c9-4ae3-8499-6c970c88f289 service nova] Acquiring lock "refresh_cache-a04eb165-88b6-4826-a4ac-c1bc51a57ba5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5b51543e-82db-4487-9061-5cf0ee1c315c req-91732772-b1c9-4ae3-8499-6c970c88f289 service nova] Acquired lock "refresh_cache-a04eb165-88b6-4826-a4ac-c1bc51a57ba5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:03 user nova-compute[75342]: DEBUG nova.network.neutron [req-5b51543e-82db-4487-9061-5cf0ee1c315c req-91732772-b1c9-4ae3-8499-6c970c88f289 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Refreshing network info cache for port 90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG nova.network.neutron [req-5b51543e-82db-4487-9061-5cf0ee1c315c req-91732772-b1c9-4ae3-8499-6c970c88f289 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Updated VIF entry in instance network info cache for port 90e051e5-17e8-4b97-92c4-2bd190722aa7. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG nova.network.neutron [req-5b51543e-82db-4487-9061-5cf0ee1c315c req-91732772-b1c9-4ae3-8499-6c970c88f289 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Updating instance_info_cache with network_info: [{"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5b51543e-82db-4487-9061-5cf0ee1c315c req-91732772-b1c9-4ae3-8499-6c970c88f289 service nova] Releasing lock "refresh_cache-a04eb165-88b6-4826-a4ac-c1bc51a57ba5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:04 user nova-compute[75342]: INFO nova.compute.manager [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Rebuilding instance
Nov 16 18:02:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-b56db723-0e3e-496c-9961-d27088f0a4b2 req-4878e751-b8fd-460a-bfb3-c77dc19525ea service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received event network-vif-unplugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b56db723-0e3e-496c-9961-d27088f0a4b2 req-4878e751-b8fd-460a-bfb3-c77dc19525ea service nova] Acquiring lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b56db723-0e3e-496c-9961-d27088f0a4b2 req-4878e751-b8fd-460a-bfb3-c77dc19525ea service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b56db723-0e3e-496c-9961-d27088f0a4b2 req-4878e751-b8fd-460a-bfb3-c77dc19525ea service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-b56db723-0e3e-496c-9961-d27088f0a4b2 req-4878e751-b8fd-460a-bfb3-c77dc19525ea service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] No waiting events found dispatching network-vif-unplugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:04 user nova-compute[75342]: WARNING nova.compute.manager [req-b56db723-0e3e-496c-9961-d27088f0a4b2 req-4878e751-b8fd-460a-bfb3-c77dc19525ea service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received unexpected event network-vif-unplugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 for instance with vm_state active and task_state rebuilding.
Nov 16 18:02:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Instance destroyed successfully.
Nov 16 18:02:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Instance destroyed successfully.
Nov 16 18:02:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1210781846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1419826400',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2YBWpL94rC07MMzLKaBsNk11Qeq2JUeq4m7GthUjfbOD5heJ9mYXBMqIg2uamJMvflvGY3eC+tTt19WLMkmpw0VhnB/T+nyASoArfoa2sGiszErzJ01aVT1fJwxYOKpw==',key_name='tempest-keypair-690867906',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fea851a0954345a0b6a29f5fa178f476',ramdisk_id='',reservation_id='r-utzjni68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-439717470',owner_user_name='tempest-ServerActionsV293TestJSON-439717470-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2efbe29024457cb872f32e561f0a21',uuid=a04eb165-88b6-4826-a4ac-c1bc51a57ba5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converting VIF {"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_vif [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90e051e5-17, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66ea0cb6-01b7-4784-9368-72ba1ae599a5) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:05 user nova-compute[75342]: INFO os_vif [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17')
Nov 16 18:02:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWYftGCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:05 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[003acc09-38ee-4713-b781-814362c27d70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:05 user nova-compute[75342]: No targets found.
Nov 16 18:02:05 user nova-compute[75342]: iSNS:
Nov 16 18:02:05 user nova-compute[75342]: No targets found.
Nov 16 18:02:05 user nova-compute[75342]: STATIC:
Nov 16 18:02:05 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19
Nov 16 18:02:05 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:05 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:05 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9
Nov 16 18:02:05 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:05 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:05 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:02:05 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:05 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:05 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa
Nov 16 18:02:05 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:05 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:05 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b
Nov 16 18:02:05 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:05 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:05 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693
Nov 16 18:02:05 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:05 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:05 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c
Nov 16 18:02:05 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:05 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:05 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584
Nov 16 18:02:05 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:05 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:05 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea
Nov 16 18:02:05 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:05 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:05 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:05 user nova-compute[75342]: No targets found.
Nov 16 18:02:05 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:05 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:05 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b07ecd4-1aed-4e4d-a1f6-7393c23ed1d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[482dbdc5-26ad-452e-b4d9-6fb365d8c417]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:05 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:05 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:05 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c86f79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a554c7d-2ae2-4b3f-97df-c41f0059e5ee]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG nova.objects.instance [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lazy-loading 'flavor' on Instance uuid 07c92356-fdd3-4884-b406-55c92c63db18 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba46a9d9-3ce4-4946-a9db-ed300afacd62]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4873a0-b9f1-42c1-9af8-02d3e5d89132]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-1724e6e5-19fb-4744-bff0-70f73bd84e45 req-d901581e-2685-46be-8be9-a230f0356e12 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-changed-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-1724e6e5-19fb-4744-bff0-70f73bd84e45 req-d901581e-2685-46be-8be9-a230f0356e12 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Refreshing instance network info cache due to event network-changed-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1724e6e5-19fb-4744-bff0-70f73bd84e45 req-d901581e-2685-46be-8be9-a230f0356e12 service nova] Acquiring lock "refresh_cache-07c92356-fdd3-4884-b406-55c92c63db18" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1724e6e5-19fb-4744-bff0-70f73bd84e45 req-d901581e-2685-46be-8be9-a230f0356e12 service nova] Acquired lock "refresh_cache-07c92356-fdd3-4884-b406-55c92c63db18" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG nova.network.neutron [req-1724e6e5-19fb-4744-bff0-70f73bd84e45 req-d901581e-2685-46be-8be9-a230f0356e12 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Refreshing network info cache for port 5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.073s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f8e999-ff40-4eeb-9e6b-139b961fe5ef]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26663653135633035', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f24bc77e', '/dev/disk/by-id/scsi-1SCST_BIOf24bc77e-fce15c050c82ff43') {{(pid=85570) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 18:02:05 user nova-compute[75342]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26663653135633035
Nov 16 18:02:05 user nova-compute[75342]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f24bc77e
Nov 16 18:02:05 user nova-compute[75342]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf24bc77e-fce15c050c82ff43
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e06a9e8-3f72-4296-8c4b-bb1332e7126e]: (4, None) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c29984-5dd0-4579-ae93-548b08caf37b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[433bbb8c-dc63-4ab0-8786-102ca3f97e99]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260]
Nov 16 18:02:05 user nova-compute[75342]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:05 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:05 user nova-compute[75342]: INFO nova.compute.manager [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Attaching volume a05c843f-c695-449f-baf7-d4b8559db14c to /dev/vdb
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a18cc3e-f131-4fc9-9529-1b034833de51]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] <== disconnect_volume: return (388ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Deleting instance files /opt/stack/data/nova/instances/a04eb165-88b6-4826-a4ac-c1bc51a57ba5_del
Nov 16 18:02:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Deletion of /opt/stack/data/nova/instances/a04eb165-88b6-4826-a4ac-c1bc51a57ba5_del complete
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.utils [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ded6c79-2f25-4451-bac8-c2d5da146833]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4772ef6e-5c23-4d01-8eef-a2a02054a6f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a97e732-b363-41ed-8427-ce7863e6e6e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eaf7c3-7036-4d80-8058-25647c718fc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:05 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:02:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1c9d15-6eb6-43f1-a37a-a8e9efdb7714]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:02:05 user nova-compute[75342]: DEBUG os_brick.utils [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Updating existing volume attachment record: 250805bc-9192-425c-89db-7a99c63b6ae7 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:02:06 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance a04eb165-88b6-4826-a4ac-c1bc51a57ba5 could not be found.
Nov 16 18:02:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWYftGCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:06 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f830ed81-6dd5-4149-866f-8a21f0d14745]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:06 user nova-compute[75342]: No targets found.
Nov 16 18:02:06 user nova-compute[75342]: iSNS:
Nov 16 18:02:06 user nova-compute[75342]: No targets found.
Nov 16 18:02:06 user nova-compute[75342]: STATIC:
Nov 16 18:02:06 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19
Nov 16 18:02:06 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:06 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:06 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9
Nov 16 18:02:06 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:06 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:06 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:02:06 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:06 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:06 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa
Nov 16 18:02:06 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:06 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:06 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b
Nov 16 18:02:06 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:06 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:06 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693
Nov 16 18:02:06 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:06 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:06 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c
Nov 16 18:02:06 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:06 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:06 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584
Nov 16 18:02:06 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:06 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:06 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:06 user nova-compute[75342]: No targets found.
Nov 16 18:02:06 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:06 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:06 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a28433b-2888-4c28-b436-46374b7f15de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-1724e6e5-19fb-4744-bff0-70f73bd84e45 req-d901581e-2685-46be-8be9-a230f0356e12 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Updated VIF entry in instance network info cache for port 5d8866e3-1d92-45b7-bdb9-aa00d8a6e402. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-1724e6e5-19fb-4744-bff0-70f73bd84e45 req-d901581e-2685-46be-8be9-a230f0356e12 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Updating instance_info_cache with network_info: [{"id": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "address": "fa:16:3e:a2:09:b8", "network": {"id": "1581948e-40b3-4da2-8d21-7884b3e60f82", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2010698692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "814d89f59bb949e7ad42a2d17774868c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d8866e3-1d", "ovs_interfaceid": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1724e6e5-19fb-4744-bff0-70f73bd84e45 req-d901581e-2685-46be-8be9-a230f0356e12 service nova] Releasing lock "refresh_cache-07c92356-fdd3-4884-b406-55c92c63db18" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[76078187-539e-4826-a501-8a36d27aa8a8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:06 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:06 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:06 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c818a050>, {}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Disconnecting from: [] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] <== disconnect_volume: return (90ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-e95bd132-7257-40a6-a01a-ff33360f5df7 req-6be0386f-892d-40b5-b7a7-77c7375c8895 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received event network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e95bd132-7257-40a6-a01a-ff33360f5df7 req-6be0386f-892d-40b5-b7a7-77c7375c8895 service nova] Acquiring lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e95bd132-7257-40a6-a01a-ff33360f5df7 req-6be0386f-892d-40b5-b7a7-77c7375c8895 service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e95bd132-7257-40a6-a01a-ff33360f5df7 req-6be0386f-892d-40b5-b7a7-77c7375c8895 service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-e95bd132-7257-40a6-a01a-ff33360f5df7 req-6be0386f-892d-40b5-b7a7-77c7375c8895 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] No waiting events found dispatching network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:07 user nova-compute[75342]: WARNING nova.compute.manager [req-e95bd132-7257-40a6-a01a-ff33360f5df7 req-6be0386f-892d-40b5-b7a7-77c7375c8895 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received unexpected event network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 for instance with vm_state active and task_state rebuilding.
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Acquiring lock "d057c823-fd25-45f9-ba3e-11a784f38064" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "d057c823-fd25-45f9-ba3e-11a784f38064" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lazy-loading 'flavor' on Instance uuid d057c823-fd25-45f9-ba3e-11a784f38064 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "d057c823-fd25-45f9-ba3e-11a784f38064" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-7abfef64-6951-462c-bb91-b925ea028227 req-4c960af3-04f0-4aa5-b2fd-7b002f3215e3 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Received event network-changed-201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-7abfef64-6951-462c-bb91-b925ea028227 req-4c960af3-04f0-4aa5-b2fd-7b002f3215e3 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Refreshing instance network info cache due to event network-changed-201ad806-d285-4ca8-91f3-5df4ba73d7e4. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7abfef64-6951-462c-bb91-b925ea028227 req-4c960af3-04f0-4aa5-b2fd-7b002f3215e3 service nova] Acquiring lock "refresh_cache-d057c823-fd25-45f9-ba3e-11a784f38064" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7abfef64-6951-462c-bb91-b925ea028227 req-4c960af3-04f0-4aa5-b2fd-7b002f3215e3 service nova] Acquired lock "refresh_cache-d057c823-fd25-45f9-ba3e-11a784f38064" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-7abfef64-6951-462c-bb91-b925ea028227 req-4c960af3-04f0-4aa5-b2fd-7b002f3215e3 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Refreshing network info cache for port 201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Acquiring lock "d057c823-fd25-45f9-ba3e-11a784f38064" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "d057c823-fd25-45f9-ba3e-11a784f38064" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:07 user nova-compute[75342]: INFO nova.compute.manager [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Attaching volume 94bacc29-21da-4144-a2e5-c6e4fd4718c4 to /dev/vdb
Nov 16 18:02:07 user nova-compute[75342]: DEBUG os_brick.utils [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eee39fc-2401-4267-9694-3e22e4067bba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3d5609-62a2-4859-83af-4b7c52bd4dd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4933de-683d-4242-ab77-b87413a7dd57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[849ec165-ee8e-44c1-85e6-972dd2f2ecee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:08 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57a9575-ace6-4a30-bada-c6660b1707df]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG os_brick.utils [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Updating existing volume attachment record: 62db2fd8-9264-42e1-bcfb-2d964f5df3b5 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG nova.network.neutron [req-7abfef64-6951-462c-bb91-b925ea028227 req-4c960af3-04f0-4aa5-b2fd-7b002f3215e3 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Updated VIF entry in instance network info cache for port 201ad806-d285-4ca8-91f3-5df4ba73d7e4. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG nova.network.neutron [req-7abfef64-6951-462c-bb91-b925ea028227 req-4c960af3-04f0-4aa5-b2fd-7b002f3215e3 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Updating instance_info_cache with network_info: [{"id": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "address": "fa:16:3e:71:76:9d", "network": {"id": "d84baa34-4221-483e-9b50-d08061b235a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-733195092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7c15cbe30d84c4aade9097427271d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201ad806-d2", "ovs_interfaceid": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7abfef64-6951-462c-bb91-b925ea028227 req-4c960af3-04f0-4aa5-b2fd-7b002f3215e3 service nova] Releasing lock "refresh_cache-d057c823-fd25-45f9-ba3e-11a784f38064" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "interface-65e77fb1-8148-46a5-bc53-139b7ea096ad-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "interface-65e77fb1-8148-46a5-bc53-139b7ea096ad-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG nova.objects.instance [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lazy-loading 'flavor' on Instance uuid 65e77fb1-8148-46a5-bc53-139b7ea096ad {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG nova.objects.instance [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lazy-loading 'pci_requests' on Instance uuid 65e77fb1-8148-46a5-bc53-139b7ea096ad {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG nova.objects.base [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Object Instance<65e77fb1-8148-46a5-bc53-139b7ea096ad> lazy-loaded attributes: flavor,pci_requests {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG nova.network.neutron [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:02:08 user nova-compute[75342]: DEBUG nova.policy [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff61915f003d41a4828ba719c2cfd0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4063aba08ce4f1d9c22413cc4ac2775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:02:09 user nova-compute[75342]: DEBUG nova.network.neutron [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Successfully created port: e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:02:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2dbef316-d68c-4a43-920f-d1ee0c68af6c req-4719b305-e4f2-4c11-8581-ed4729ac4c13 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-changed-f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2dbef316-d68c-4a43-920f-d1ee0c68af6c req-4719b305-e4f2-4c11-8581-ed4729ac4c13 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Refreshing instance network info cache due to event network-changed-f1d3a970-40d8-420b-b632-c0231545cd41. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:02:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2dbef316-d68c-4a43-920f-d1ee0c68af6c req-4719b305-e4f2-4c11-8581-ed4729ac4c13 service nova] Acquiring lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2dbef316-d68c-4a43-920f-d1ee0c68af6c req-4719b305-e4f2-4c11-8581-ed4729ac4c13 service nova] Acquired lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-2dbef316-d68c-4a43-920f-d1ee0c68af6c req-4719b305-e4f2-4c11-8581-ed4729ac4c13 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Refreshing network info cache for port f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:02:10 user nova-compute[75342]: DEBUG nova.network.neutron [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Successfully updated port: e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:02:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-03ef1f30-afdd-4acd-99cc-f5e0e7c3585d req-8277f5f8-9802-4c55-a94e-b60e92ea09e1 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-changed-e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-03ef1f30-afdd-4acd-99cc-f5e0e7c3585d req-8277f5f8-9802-4c55-a94e-b60e92ea09e1 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Refreshing instance network info cache due to event network-changed-e1665c78-8646-4a63-ac74-63d44bb0295a. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:02:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-03ef1f30-afdd-4acd-99cc-f5e0e7c3585d req-8277f5f8-9802-4c55-a94e-b60e92ea09e1 service nova] Acquiring lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:10 user nova-compute[75342]: DEBUG nova.network.neutron [req-2dbef316-d68c-4a43-920f-d1ee0c68af6c req-4719b305-e4f2-4c11-8581-ed4729ac4c13 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Updated VIF entry in instance network info cache for port f1d3a970-40d8-420b-b632-c0231545cd41. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:02:10 user nova-compute[75342]: DEBUG nova.network.neutron [req-2dbef316-d68c-4a43-920f-d1ee0c68af6c req-4719b305-e4f2-4c11-8581-ed4729ac4c13 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Updating instance_info_cache with network_info: [{"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2dbef316-d68c-4a43-920f-d1ee0c68af6c req-4719b305-e4f2-4c11-8581-ed4729ac4c13 service nova] Releasing lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquired lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:10 user nova-compute[75342]: DEBUG nova.network.neutron [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.network.neutron [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Updating instance_info_cache with network_info: [{"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1665c78-8646-4a63-ac74-63d44bb0295a", "address": "fa:16:3e:a9:61:19", "network": {"id": "4cecbd03-4fda-4d73-a448-79b6109f21c5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-725026521", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1665c78-86", "ovs_interfaceid": "e1665c78-8646-4a63-ac74-63d44bb0295a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Releasing lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-03ef1f30-afdd-4acd-99cc-f5e0e7c3585d req-8277f5f8-9802-4c55-a94e-b60e92ea09e1 service nova] Acquired lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.network.neutron [req-03ef1f30-afdd-4acd-99cc-f5e0e7c3585d req-8277f5f8-9802-4c55-a94e-b60e92ea09e1 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Refreshing network info cache for port e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1632151976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1632151976',id=9,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzlRPxa4PAPm45PMmq6l0+fBK9hV73ZL6geqM+y/RLFGg/C77lh7irpPP6ckBjAuzTfCveRgeMZjCC7DsaDkkVKcV+qSujYvT8RzL81EPVckf4RjSVpsZxqrwxx8lsoJw==',key_name='tempest-keypair-1617085374',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a4063aba08ce4f1d9c22413cc4ac2775',ramdisk_id='',reservation_id='r-ilc0wgmz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1574754300',owner_user_name='tempest-TaggedAttachmentsTest-1574754300-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61915f003d41a4828ba719c2cfd0a2',uuid=65e77fb1-8148-46a5-bc53-139b7ea096ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1665c78-8646-4a63-ac74-63d44bb0295a", "address": "fa:16:3e:a9:61:19", "network": {"id": "4cecbd03-4fda-4d73-a448-79b6109f21c5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-725026521", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1665c78-86", "ovs_interfaceid": "e1665c78-8646-4a63-ac74-63d44bb0295a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converting VIF {"id": "e1665c78-8646-4a63-ac74-63d44bb0295a", "address": "fa:16:3e:a9:61:19", "network": {"id": "4cecbd03-4fda-4d73-a448-79b6109f21c5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-725026521", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1665c78-86", "ovs_interfaceid": "e1665c78-8646-4a63-ac74-63d44bb0295a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:61:19,bridge_name='br-int',has_traffic_filtering=True,id=e1665c78-8646-4a63-ac74-63d44bb0295a,network=Network(4cecbd03-4fda-4d73-a448-79b6109f21c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1665c78-86') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG os_vif [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:61:19,bridge_name='br-int',has_traffic_filtering=True,id=e1665c78-8646-4a63-ac74-63d44bb0295a,network=Network(4cecbd03-4fda-4d73-a448-79b6109f21c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1665c78-86') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7da60970-3dea-5e16-ab32-6813e8ebe44d', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1665c78-86, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1665c78-86, col_values=(('qos', UUID('e5a186b8-cb38-48ce-a0f4-23401bf270d4')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1665c78-86, col_values=(('external_ids', {'iface-id': 'e1665c78-8646-4a63-ac74-63d44bb0295a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:61:19', 'vm-uuid': '65e77fb1-8148-46a5-bc53-139b7ea096ad'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: INFO os_vif [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:61:19,bridge_name='br-int',has_traffic_filtering=True,id=e1665c78-8646-4a63-ac74-63d44bb0295a,network=Network(4cecbd03-4fda-4d73-a448-79b6109f21c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1665c78-86')
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1632151976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1632151976',id=9,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzlRPxa4PAPm45PMmq6l0+fBK9hV73ZL6geqM+y/RLFGg/C77lh7irpPP6ckBjAuzTfCveRgeMZjCC7DsaDkkVKcV+qSujYvT8RzL81EPVckf4RjSVpsZxqrwxx8lsoJw==',key_name='tempest-keypair-1617085374',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a4063aba08ce4f1d9c22413cc4ac2775',ramdisk_id='',reservation_id='r-ilc0wgmz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1574754300',owner_user_name='tempest-TaggedAttachmentsTest-1574754300-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61915f003d41a4828ba719c2cfd0a2',uuid=65e77fb1-8148-46a5-bc53-139b7ea096ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1665c78-8646-4a63-ac74-63d44bb0295a", "address": "fa:16:3e:a9:61:19", "network": {"id": "4cecbd03-4fda-4d73-a448-79b6109f21c5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-725026521", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1665c78-86", "ovs_interfaceid": "e1665c78-8646-4a63-ac74-63d44bb0295a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converting VIF {"id": "e1665c78-8646-4a63-ac74-63d44bb0295a", "address": "fa:16:3e:a9:61:19", "network": {"id": "4cecbd03-4fda-4d73-a448-79b6109f21c5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-725026521", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1665c78-86", "ovs_interfaceid": "e1665c78-8646-4a63-ac74-63d44bb0295a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:61:19,bridge_name='br-int',has_traffic_filtering=True,id=e1665c78-8646-4a63-ac74-63d44bb0295a,network=Network(4cecbd03-4fda-4d73-a448-79b6109f21c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1665c78-86') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] attach device xml: <interface type="ethernet">
Nov 16 18:02:11 user nova-compute[75342]:   <mac address="fa:16:3e:a9:61:19"/>
Nov 16 18:02:11 user nova-compute[75342]:   <model type="virtio"/>
Nov 16 18:02:11 user nova-compute[75342]:   <mtu size="1442"/>
Nov 16 18:02:11 user nova-compute[75342]:   <target dev="tape1665c78-86"/>
Nov 16 18:02:11 user nova-compute[75342]: </interface>
Nov 16 18:02:11 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.network.neutron [req-03ef1f30-afdd-4acd-99cc-f5e0e7c3585d req-8277f5f8-9802-4c55-a94e-b60e92ea09e1 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Updated VIF entry in instance network info cache for port e1665c78-8646-4a63-ac74-63d44bb0295a. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.network.neutron [req-03ef1f30-afdd-4acd-99cc-f5e0e7c3585d req-8277f5f8-9802-4c55-a94e-b60e92ea09e1 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Updating instance_info_cache with network_info: [{"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1665c78-8646-4a63-ac74-63d44bb0295a", "address": "fa:16:3e:a9:61:19", "network": {"id": "4cecbd03-4fda-4d73-a448-79b6109f21c5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-725026521", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1665c78-86", "ovs_interfaceid": "e1665c78-8646-4a63-ac74-63d44bb0295a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] No BDM found with device name hda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] No VIF found with MAC fa:16:3e:c1:51:1f, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-03ef1f30-afdd-4acd-99cc-f5e0e7c3585d req-8277f5f8-9802-4c55-a94e-b60e92ea09e1 service nova] Releasing lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:02:11 user nova-compute[75342]:   <nova:package version="0.0.0"/>
Nov 16 18:02:11 user nova-compute[75342]:   <nova:name>tempest-device-tagging-server-1632151976</nova:name>
Nov 16 18:02:11 user nova-compute[75342]:   <nova:creationTime>2023-11-16 18:02:11</nova:creationTime>
Nov 16 18:02:11 user nova-compute[75342]:   <nova:flavor name="m1.tiny">
Nov 16 18:02:11 user nova-compute[75342]:     <nova:memory>512</nova:memory>
Nov 16 18:02:11 user nova-compute[75342]:     <nova:disk>1</nova:disk>
Nov 16 18:02:11 user nova-compute[75342]:     <nova:swap>0</nova:swap>
Nov 16 18:02:11 user nova-compute[75342]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:02:11 user nova-compute[75342]:     <nova:vcpus>1</nova:vcpus>
Nov 16 18:02:11 user nova-compute[75342]:   </nova:flavor>
Nov 16 18:02:11 user nova-compute[75342]:   <nova:owner>
Nov 16 18:02:11 user nova-compute[75342]:     <nova:user uuid="ff61915f003d41a4828ba719c2cfd0a2">tempest-TaggedAttachmentsTest-1574754300-project-member</nova:user>
Nov 16 18:02:11 user nova-compute[75342]:     <nova:project uuid="a4063aba08ce4f1d9c22413cc4ac2775">tempest-TaggedAttachmentsTest-1574754300</nova:project>
Nov 16 18:02:11 user nova-compute[75342]:   </nova:owner>
Nov 16 18:02:11 user nova-compute[75342]:   <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:02:11 user nova-compute[75342]:   <nova:ports>
Nov 16 18:02:11 user nova-compute[75342]:     <nova:port uuid="f1d3a970-40d8-420b-b632-c0231545cd41">
Nov 16 18:02:11 user nova-compute[75342]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 18:02:11 user nova-compute[75342]:     </nova:port>
Nov 16 18:02:11 user nova-compute[75342]:     <nova:port uuid="e1665c78-8646-4a63-ac74-63d44bb0295a">
Nov 16 18:02:11 user nova-compute[75342]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 16 18:02:11 user nova-compute[75342]:     </nova:port>
Nov 16 18:02:11 user nova-compute[75342]:   </nova:ports>
Nov 16 18:02:11 user nova-compute[75342]: </nova:instance>
Nov 16 18:02:11 user nova-compute[75342]:  {{(pid=75342) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ae4974d-7510-4488-b4ef-1b7eb0d62bd2 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "interface-65e77fb1-8148-46a5-bc53-139b7ea096ad-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.331s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-a1aa8df1-115e-4c44-9956-340250aab17f req-e7fdc2f3-2e65-43ea-91c1-73484e18016b service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-vif-plugged-e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a1aa8df1-115e-4c44-9956-340250aab17f req-e7fdc2f3-2e65-43ea-91c1-73484e18016b service nova] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a1aa8df1-115e-4c44-9956-340250aab17f req-e7fdc2f3-2e65-43ea-91c1-73484e18016b service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a1aa8df1-115e-4c44-9956-340250aab17f req-e7fdc2f3-2e65-43ea-91c1-73484e18016b service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-a1aa8df1-115e-4c44-9956-340250aab17f req-e7fdc2f3-2e65-43ea-91c1-73484e18016b service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] No waiting events found dispatching network-vif-plugged-e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:11 user nova-compute[75342]: WARNING nova.compute.manager [req-a1aa8df1-115e-4c44-9956-340250aab17f req-e7fdc2f3-2e65-43ea-91c1-73484e18016b service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received unexpected event network-vif-plugged-e1665c78-8646-4a63-ac74-63d44bb0295a for instance with vm_state active and task_state None.
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG nova.compute.manager [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Preparing to wait for external event volume-reimaged-e99588c0-6d23-4cdf-b077-4d9d23522cea {{(pid=75342) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG nova.objects.instance [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lazy-loading 'flavor' on Instance uuid 65e77fb1-8148-46a5-bc53-139b7ea096ad {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMaZWImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:12 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:12 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:12 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[12baaf59-5df5-47b4-9adc-42487865f7ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:02:12 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[da67cce6-a0f1-4cc3-918f-dbf26e2c7e8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c] added
Nov 16 18:02:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cae100d-18aa-4ff2-97a2-d1098bc1272c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c8dd24-be16-4cee-96eb-a72491d77db5]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMaZWImv {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMaZWImv" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b75158-81a5-4ea2-9550-50714b98a9a3]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EMaZWImv'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a47f1a7-923f-4efb-8ca3-7604e69d7f6c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:13 user nova-compute[75342]: INFO nova.compute.manager [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Attaching volume c3b705e5-f82d-478d-8b89-e352f0e5a8da to /dev/vdb
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eade67df-b48f-46bb-83c8-123638324157]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.utils [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d59c6d5-cac8-4e20-a1b8-24054ddb00b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79a38f2-efea-4f2d-8738-0c5b3b52ddc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06dfd51-3568-4cfd-9149-2ac98008d0ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[527f2cb0-c8f3-4c75-ad95-6e4c35e14f4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0932693-ad64-4465-b977-8132e502e054]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260]
Nov 16 18:02:13 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:13 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f17ec7-0999-46a1-a9ed-024ef3da3a3b]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.utils [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Updating existing volume attachment record: 33419eaf-5378-4e62-a5db-376549e4f3d4 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f31fb2-2d77-4748-90e3-002450dab62d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc9891f-abf7-494e-8864-3e849364be75]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:13 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4f482e-e8eb-4abd-8281-550c9fa964a2]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMaZWImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRihFtIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:13 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-493af8ec-5e95-4916-9383-7cd4e5be0e55 req-f442b141-fbc6-4c53-8db4-34fd7daa91b8 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-vif-plugged-e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-493af8ec-5e95-4916-9383-7cd4e5be0e55 req-f442b141-fbc6-4c53-8db4-34fd7daa91b8 service nova] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-493af8ec-5e95-4916-9383-7cd4e5be0e55 req-f442b141-fbc6-4c53-8db4-34fd7daa91b8 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-493af8ec-5e95-4916-9383-7cd4e5be0e55 req-f442b141-fbc6-4c53-8db4-34fd7daa91b8 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-493af8ec-5e95-4916-9383-7cd4e5be0e55 req-f442b141-fbc6-4c53-8db4-34fd7daa91b8 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] No waiting events found dispatching network-vif-plugged-e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:13 user nova-compute[75342]: WARNING nova.compute.manager [req-493af8ec-5e95-4916-9383-7cd4e5be0e55 req-f442b141-fbc6-4c53-8db4-34fd7daa91b8 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received unexpected event network-vif-plugged-e1665c78-8646-4a63-ac74-63d44bb0295a for instance with vm_state active and task_state None.
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23532613663643564', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532613663643564', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.748s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:14 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:14 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG nova.objects.instance [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lazy-loading 'flavor' on Instance uuid 07c92356-fdd3-4884-b406-55c92c63db18 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fec95f-9adf-41a9-9bf1-c589b0ad6d1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:02:14 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:02:14 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:14 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:02:14 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:02:14 user nova-compute[75342]:   <serial>a05c843f-c695-449f-baf7-d4b8559db14c</serial>
Nov 16 18:02:14 user nova-compute[75342]: </disk>
Nov 16 18:02:14 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[081d66d7-e4e2-4b6f-9d1e-8554eaa30cde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4] added
Nov 16 18:02:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d83d51-7f52-4920-ac1f-13182f5d4c87]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbccde37-e9e8-43c2-b232-f2aae69f5329]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRihFtIV {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRihFtIV" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2f5912-bd7e-4aeb-8717-a90da58cab26]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jRihFtIV'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7892ec8-37b8-4885-8c4d-52477566906f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5444a6fd-e1ed-4ed4-b537-eb6220c6caa0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3945493a-87d7-42ca-86a0-358830a2613a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4, portal: 172.16.0.220,3260]
Nov 16 18:02:14 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[721b4cf9-8ac1-4206-bcbe-25d862917995]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa12b41-fa04-4953-877a-578e0032c413]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:14 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[972d5218-7c38-4dfc-92c2-d67ffa29c7da]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRihFtIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] No VIF found with MAC fa:16:3e:a2:09:b8, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:02:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0baed584-a0db-4264-a2a8-b35729dd0ad5 tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.113s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] <== connect_volume: return (2116ms) {'type': 'block', 'scsi_wwn': '23065373361646434', 'path': '/dev/sdk'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065373361646434', 'path': '/dev/sdk'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:02:15 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lazy-loading 'flavor' on Instance uuid d057c823-fd25-45f9-ba3e-11a784f38064 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] attach device xml: <disk type="block" device="disk">
Nov 16 18:02:15 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:15 user nova-compute[75342]:   <source dev="/dev/sdk"/>
Nov 16 18:02:15 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:02:15 user nova-compute[75342]:   <serial>94bacc29-21da-4144-a2e5-c6e4fd4718c4</serial>
Nov 16 18:02:15 user nova-compute[75342]: </disk>
Nov 16 18:02:15 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] No VIF found with MAC fa:16:3e:71:76:9d, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9177ce23-eccd-4e25-a4f3-d2816195dd3c tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "d057c823-fd25-45f9-ba3e-11a784f38064" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.457s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "07c92356-fdd3-4884-b406-55c92c63db18" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG os_brick.utils [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97db65e-1144-4d20-8f0f-b32c26d3e409]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e6eb61-27bf-4dea-b1c8-ec3e0f1444a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7038550-9434-4c6f-a36a-b0145a93987b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ffed5e-4d4e-45f3-86e7-1c09b7947071]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:16 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:02:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac79fae-69a7-45fb-9a55-a76e89350add]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:02:16 user nova-compute[75342]: DEBUG os_brick.utils [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:16 user nova-compute[75342]: INFO nova.compute.manager [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Swapping volume a05c843f-c695-449f-baf7-d4b8559db14c for 02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c435e34c-002b-4a1e-b863-2fd1efadddf6 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] volume_snapshot_create: create_info: {'snapshot_id': '3b383e6f-41a2-4028-9911-9f10c0323508', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75342) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 16 18:02:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c435e34c-002b-4a1e-b863-2fd1efadddf6 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] snap xml: <domainsnapshot>
Nov 16 18:02:17 user nova-compute[75342]:   <disks>
Nov 16 18:02:17 user nova-compute[75342]:     <disk name="/dev/sdk" snapshot="external" type="file">
Nov 16 18:02:17 user nova-compute[75342]:       <source file="/dev/new_file"/>
Nov 16 18:02:17 user nova-compute[75342]:     </disk>
Nov 16 18:02:17 user nova-compute[75342]:     <disk name="vda" snapshot="no"/>
Nov 16 18:02:17 user nova-compute[75342]:   </disks>
Nov 16 18:02:17 user nova-compute[75342]: </domainsnapshot>
Nov 16 18:02:17 user nova-compute[75342]:  {{(pid=75342) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 16 18:02:17 user nova-compute[75342]: DEBUG nova.objects.instance [None req-c435e34c-002b-4a1e-b863-2fd1efadddf6 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] Lazy-loading 'system_metadata' on Instance uuid d057c823-fd25-45f9-ba3e-11a784f38064 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:17 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c435e34c-002b-4a1e-b863-2fd1efadddf6 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [None req-c435e34c-002b-4a1e-b863-2fd1efadddf6 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Traceback (most recent call last):
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     rv = execute(f, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     six.reraise(c, e, tb)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     raise value
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     rv = meth(*args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064] 
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [None req-c435e34c-002b-4a1e-b863-2fd1efadddf6 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Traceback (most recent call last):
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     self._volume_snapshot_create(context, instance, guest,
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     rv = execute(f, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     six.reraise(c, e, tb)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     raise value
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     rv = meth(*args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064] 
Nov 16 18:02:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-528ebd6b-6f40-42c7-acfd-1426a3fabfb2 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] volume_snapshot_delete: delete_info: {'volume_id': '94bacc29-21da-4144-a2e5-c6e4fd4718c4'} {{(pid=75342) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [None req-528ebd6b-6f40-42c7-acfd-1426a3fabfb2 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Traceback (most recent call last):
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064]     if delete_info['type'] != 'qcow2':
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064] KeyError: 'type'
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [instance: d057c823-fd25-45f9-ba3e-11a784f38064] 
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [None req-c435e34c-002b-4a1e-b863-2fd1efadddf6 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 3b383e6f-41a2-4028-9911-9f10c0323508 could not be found.
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     raise value
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver 
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver 
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 3b383e6f-41a2-4028-9911-9f10c0323508 could not be found. (HTTP 404) (Request-ID: req-ab06182b-c5a6-4d6e-bd91-5144e068469f)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver 
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver 
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 3b383e6f-41a2-4028-9911-9f10c0323508 could not be found.
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver 
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server [None req-c435e34c-002b-4a1e-b863-2fd1efadddf6 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     raise value
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server 
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver [None req-528ebd6b-6f40-42c7-acfd-1426a3fabfb2 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver 
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver 
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-43c5fdf2-b9d1-45b0-9498-11112084e61e)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver 
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver 
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 18:02:17 user nova-compute[75342]: ERROR nova.virt.libvirt.driver 
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server [None req-528ebd6b-6f40-42c7-acfd-1426a3fabfb2 tempest-VolumesAssistedSnapshotsTest-2098332898 tempest-VolumesAssistedSnapshotsTest-2098332898-project] Exception during message handling: KeyError: 'type'
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 16 18:02:17 user nova-compute[75342]: ERROR oslo_messaging.rpc.server 
Nov 16 18:02:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Acquiring lock "d057c823-fd25-45f9-ba3e-11a784f38064" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "d057c823-fd25-45f9-ba3e-11a784f38064" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:17 user nova-compute[75342]: INFO nova.compute.manager [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Detaching volume 94bacc29-21da-4144-a2e5-c6e4fd4718c4
Nov 16 18:02:17 user nova-compute[75342]: INFO nova.virt.block_device [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Attempting to driver detach volume 94bacc29-21da-4144-a2e5-c6e4fd4718c4 from mountpoint /dev/vdb
Nov 16 18:02:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Attempting to detach device vdb from instance d057c823-fd25-45f9-ba3e-11a784f38064 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:02:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 18:02:17 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:17 user nova-compute[75342]:   <source dev="/dev/sdk"/>
Nov 16 18:02:17 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:02:17 user nova-compute[75342]:   <serial>94bacc29-21da-4144-a2e5-c6e4fd4718c4</serial>
Nov 16 18:02:17 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:02:17 user nova-compute[75342]: </disk>
Nov 16 18:02:17 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:02:17 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Successfully detached device vdb from instance d057c823-fd25-45f9-ba3e-11a784f38064 from the persistent domain config.
Nov 16 18:02:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d057c823-fd25-45f9-ba3e-11a784f38064 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:02:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 18:02:17 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:17 user nova-compute[75342]:   <source dev="/dev/sdk"/>
Nov 16 18:02:17 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:02:17 user nova-compute[75342]:   <serial>94bacc29-21da-4144-a2e5-c6e4fd4718c4</serial>
Nov 16 18:02:17 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:02:17 user nova-compute[75342]: </disk>
Nov 16 18:02:17 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:02:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d057c823-fd25-45f9-ba3e-11a784f38064 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:02:18 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 is timed out.
Nov 16 18:02:18 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Successfully detached device vdb from instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 from the live domain config.
Nov 16 18:02:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geQAcXGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:18 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1004579f-6293-4716-b8b3-21013a272dac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:18 user nova-compute[75342]: No targets found.
Nov 16 18:02:18 user nova-compute[75342]: iSNS:
Nov 16 18:02:18 user nova-compute[75342]: No targets found.
Nov 16 18:02:18 user nova-compute[75342]: STATIC:
Nov 16 18:02:18 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19
Nov 16 18:02:18 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:18 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:18 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9
Nov 16 18:02:18 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:18 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:18 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:02:18 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:18 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:18 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c
Nov 16 18:02:18 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:18 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:18 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa
Nov 16 18:02:18 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:18 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:18 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b
Nov 16 18:02:18 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:18 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:18 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693
Nov 16 18:02:18 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:18 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:18 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4
Nov 16 18:02:18 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:18 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:18 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c
Nov 16 18:02:18 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:18 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:18 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584
Nov 16 18:02:18 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:18 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:18 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:18 user nova-compute[75342]: No targets found.
Nov 16 18:02:18 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:18 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:18 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedaedec-bd94-42aa-8954-3e261cb624c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f352f1-ca6b-4b05-bf4b-2ec8b1d7eeb6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:19 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:19 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:19 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6d13d4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9'): ({'sdi'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Removing single pathed devices sdi {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14a86a8-445e-42a4-bef9-82d2a1b0bb39]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[28de2069-1c92-4f7b-9a22-47709610e38d]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Flushing IO for device /dev/sdi {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d046c56-9bc9-40e2-89a0-3d89fadce630]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06763d8-c8fc-4cbc-862b-d23246115ed1]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] SCSI volumes sdi have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffa39a1-81ff-4285-8017-b0601f873044]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaf323e-5730-4f6a-b657-27c5d8f253cd]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9, portal: 172.16.0.220,3260]
Nov 16 18:02:19 user nova-compute[75342]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:19 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e544b55c-dc09-4117-aa3a-26c60bac06a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d318aba-d2b6-40b0-8402-bd383f55b05f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] <== disconnect_volume: return (355ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:20 user nova-compute[75342]: DEBUG nova.objects.instance [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lazy-loading 'flavor' on Instance uuid edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-615b340b-0aea-40ed-a9e9-4e82d76235cf tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.704s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG nova.compute.manager [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKnRMxyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07c92356-fdd3-4884-b406-55c92c63db18', 'attached_at': '', 'detached_at': '', 'volume_id': '02fa77ca-71f8-462f-977c-a9868c80fd9c', 'serial': '02fa77ca-71f8-462f-977c-a9868c80fd9c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMaZWImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '07c92356-fdd3-4884-b406-55c92c63db18', 'attached_at': '', 'detached_at': '', 'volume_id': 'a05c843f-c695-449f-baf7-d4b8559db14c', 'serial'} {{(pid=75342) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKnRMxyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:22 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:22 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:22 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9b16d0-cb46-4e55-b81e-0939a1a40156]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:02:22 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5de5da7-66f0-4540-981a-7b0e3ef26f5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c] added
Nov 16 18:02:22 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[351f6c9c-cf67-4733-b674-00e70cfb6ac0]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9b4a6b-72dd-4a0b-93f4-f7769196b4f5]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKnRMxyo {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKnRMxyo" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c99390-e449-485e-8b06-d593b7775ba3]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kKnRMxyo'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c50f14b-15fb-4465-888e-e0128f7a5a04]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6709ca6a-534c-4925-a071-3263198e22c5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:22 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:22 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[285f6458-91a3-427a-b56c-f3516d6c36b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c, portal: 172.16.0.220,3260]
Nov 16 18:02:22 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:22 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:22 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance e00c5b4b-e155-4513-bda3-7eea536e8742 is timed out.
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e03ade-d8f1-4556-bbeb-5bcdb1e264ac]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:22 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Successfully detached device sdc from instance e00c5b4b-e155-4513-bda3-7eea536e8742 from the live domain config.
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWKAFhgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:22 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[982e0675-7502-45fd-b9ec-b9abfd681f96]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:22 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:22 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:22 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b73f471-c7b3-42eb-b28b-b6f5df8a20c8]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:02:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKnRMxyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23032363064383263', 'path': '/dev/sdi'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032363064383263', 'path': '/dev/sdi'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.064s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG nova.objects.instance [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lazy-loading 'flavor' on Instance uuid 07c92356-fdd3-4884-b406-55c92c63db18 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f57def4-94f9-437d-bb66-35b1a3777470]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:23 user nova-compute[75342]: No targets found.
Nov 16 18:02:23 user nova-compute[75342]: iSNS:
Nov 16 18:02:23 user nova-compute[75342]: No targets found.
Nov 16 18:02:23 user nova-compute[75342]: STATIC:
Nov 16 18:02:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19
Nov 16 18:02:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:02:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c
Nov 16 18:02:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa
Nov 16 18:02:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b
Nov 16 18:02:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693
Nov 16 18:02:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4
Nov 16 18:02:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c
Nov 16 18:02:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584
Nov 16 18:02:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:23 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:23 user nova-compute[75342]: No targets found.
Nov 16 18:02:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:23 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:23 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[42353a75-3f6b-4546-b808-70d9f2896793]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f67277-a7c4-4fd5-a1da-6319bb10f5a4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:23 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c87bb400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693'): ({'sdj'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Removing single pathed devices sdj {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a08aed-b08a-481d-808e-cdade2443007]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e097722d-18ae-4860-b555-94660722c12b]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Flushing IO for device /dev/sdj {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b883d760-d664-41f3-84ff-35705004dd47]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.052s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97104889-d461-4729-a4fb-f9c258652a85]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] SCSI volumes sdj have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b4cb51-e6cd-406e-8ca6-edd4cc6ee956]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WFsTLHBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:23 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6857740-1bb0-4e5d-87cd-a7f174005dae]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693, portal: 172.16.0.220,3260]
Nov 16 18:02:23 user nova-compute[75342]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:537757ae-b43e-4441-8d0e-594d15f1f693 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0489300c-c2f5-40a1-9f92-68c19a91181c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] <== disconnect_volume: return (1430ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.107s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:23 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:23 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[348cb968-b289-482b-85d7-582510fd15e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:02:23 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[845f5bb5-4e5c-47ae-ad54-64d1875a6c86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da] added
Nov 16 18:02:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb6d876-5131-442a-9cf5-aa883560d61c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6484343f-e8dc-48b5-a217-d1ff64c8ca91]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WFsTLHBa {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WFsTLHBa" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac906288-1769-4869-a5b5-6b6c2958cfae]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WFsTLHBa'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e15d0c-946a-4410-a265-95eeeb6da9ac]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0be29af-a9e5-43a5-8401-b844825cdbe8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d7292c-3092-4ea1-a975-f00fcaf7157e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da, portal: 172.16.0.220,3260]
Nov 16 18:02:24 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a29327-4849-48fc-a557-219a6fa87c10]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.058s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb3a7d8-4d4a-44cc-8f5f-08f0543471b3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:24 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.444s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] HCTL ('43', '-', '-', 0) found on session 16 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e57c8d-3d6f-4078-9e2e-88ca10f42cca]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Searching for a device in session 16 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WFsTLHBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 137363456 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 292552704 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG nova.objects.instance [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lazy-loading 'flavor' on Instance uuid e00c5b4b-e155-4513-bda3-7eea536e8742 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-396e7c81-236c-4c8d-be63-c26bcfc727a8 tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.104s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.492s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] <== connect_volume: return (1601ms) {'type': 'block', 'scsi_wwn': '23534646461323164', 'path': '/dev/sdl'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534646461323164', 'path': '/dev/sdl'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG nova.compute.manager [req-dc26cfd5-30b2-4479-bfbe-4aa7a9603a39 req-0d152487-e987-47ff-9ad9-6bfe3fb906db service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-changed-b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG nova.compute.manager [req-dc26cfd5-30b2-4479-bfbe-4aa7a9603a39 req-0d152487-e987-47ff-9ad9-6bfe3fb906db service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing instance network info cache due to event network-changed-b611b37d-a062-41de-9792-7a3c5c60cfc4. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dc26cfd5-30b2-4479-bfbe-4aa7a9603a39 req-0d152487-e987-47ff-9ad9-6bfe3fb906db service nova] Acquiring lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dc26cfd5-30b2-4479-bfbe-4aa7a9603a39 req-0d152487-e987-47ff-9ad9-6bfe3fb906db service nova] Acquired lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG nova.network.neutron [req-dc26cfd5-30b2-4479-bfbe-4aa7a9603a39 req-0d152487-e987-47ff-9ad9-6bfe3fb906db service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Refreshing network info cache for port b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG nova.objects.instance [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lazy-loading 'flavor' on Instance uuid 65e77fb1-8148-46a5-bc53-139b7ea096ad {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:02:25 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:25 user nova-compute[75342]:   <source dev="/dev/sdl"/>
Nov 16 18:02:25 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:02:25 user nova-compute[75342]:   <serial>c3b705e5-f82d-478d-8b89-e352f0e5a8da</serial>
Nov 16 18:02:25 user nova-compute[75342]: </disk>
Nov 16 18:02:25 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 451936256 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG nova.network.neutron [req-dc26cfd5-30b2-4479-bfbe-4aa7a9603a39 req-0d152487-e987-47ff-9ad9-6bfe3fb906db service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updated VIF entry in instance network info cache for port b611b37d-a062-41de-9792-7a3c5c60cfc4. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG nova.network.neutron [req-dc26cfd5-30b2-4479-bfbe-4aa7a9603a39 req-0d152487-e987-47ff-9ad9-6bfe3fb906db service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating instance_info_cache with network_info: [{"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 610271232 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] No BDM found with device name hda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] No VIF found with MAC fa:16:3e:c1:51:1f, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dc26cfd5-30b2-4479-bfbe-4aa7a9603a39 req-0d152487-e987-47ff-9ad9-6bfe3fb906db service nova] Releasing lock "refresh_cache-77a26e02-f97e-4911-9dd4-3f6f30d92edc" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "e00c5b4b-e155-4513-bda3-7eea536e8742" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:26 user nova-compute[75342]: INFO nova.compute.manager [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Terminating instance
Nov 16 18:02:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6f92463a-3c01-449a-9f68-c12994d7a3fa tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.136s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-da25ea32-8232-4298-994e-f63f747f018c req-0cca6d1a-7d96-4d15-97b9-56e704fa0060 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Received event network-vif-unplugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-da25ea32-8232-4298-994e-f63f747f018c req-0cca6d1a-7d96-4d15-97b9-56e704fa0060 service nova] Acquiring lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-da25ea32-8232-4298-994e-f63f747f018c req-0cca6d1a-7d96-4d15-97b9-56e704fa0060 service nova] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-da25ea32-8232-4298-994e-f63f747f018c req-0cca6d1a-7d96-4d15-97b9-56e704fa0060 service nova] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-da25ea32-8232-4298-994e-f63f747f018c req-0cca6d1a-7d96-4d15-97b9-56e704fa0060 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] No waiting events found dispatching network-vif-unplugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-da25ea32-8232-4298-994e-f63f747f018c req-0cca6d1a-7d96-4d15-97b9-56e704fa0060 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Received event network-vif-unplugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 734003200 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Instance destroyed successfully.
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.objects.instance [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lazy-loading 'resources' on Instance uuid e00c5b4b-e155-4513-bda3-7eea536e8742 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 831520768 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T17:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-212087695',display_name='tempest-AttachSCSIVolumeTestJSON-server-212087695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-212087695',id=6,image_ref='9f61628a-de96-4ff7-b90a-cc8a015073f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeyIDAbbVoglYEO59g97jZwGFjhdQy3pd6/TTiiFZUobB3tUBErOHSgPWhUK9Rusutz7vrXyEykPjbFHgUZRRBWlLzTDjVTO/Gs5BVCOUlaimCQoOVi5l4K9o7Qh+GYHQ==',key_name='tempest-keypair-90691677',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84123b277d334ce38d98292f7178eea6',ramdisk_id='',reservation_id='r-0hr01sho',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9f61628a-de96-4ff7-b90a-cc8a015073f4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-988371779',owner_user_name='tempest-AttachSCSIVolumeTestJSON-988371779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e107ad21c24043b7b56248c7c1e88c02',uuid=e00c5b4b-e155-4513-bda3-7eea536e8742,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "address": "fa:16:3e:4a:0c:36", "network": {"id": "bf70d248-3de6-4375-85f0-c7b29d766fc1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1928035521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84123b277d334ce38d98292f7178eea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf8ff34-74", "ovs_interfaceid": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Converting VIF {"id": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "address": "fa:16:3e:4a:0c:36", "network": {"id": "bf70d248-3de6-4375-85f0-c7b29d766fc1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1928035521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84123b277d334ce38d98292f7178eea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf8ff34-74", "ovs_interfaceid": "ebf8ff34-740f-4344-9caf-aec4d0b51afc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=ebf8ff34-740f-4344-9caf-aec4d0b51afc,network=Network(bf70d248-3de6-4375-85f0-c7b29d766fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf8ff34-74') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG os_vif [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=ebf8ff34-740f-4344-9caf-aec4d0b51afc,network=Network(bf70d248-3de6-4375-85f0-c7b29d766fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf8ff34-74') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebf8ff34-74, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ceeb26b-96a3-4881-8cf7-cdb08b39402c) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:27 user nova-compute[75342]: INFO os_vif [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=ebf8ff34-740f-4344-9caf-aec4d0b51afc,network=Network(bf70d248-3de6-4375-85f0-c7b29d766fc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf8ff34-74')
Nov 16 18:02:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Deleting instance files /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742_del
Nov 16 18:02:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Deletion of /opt/stack/data/nova/instances/e00c5b4b-e155-4513-bda3-7eea536e8742_del complete
Nov 16 18:02:27 user nova-compute[75342]: INFO nova.compute.manager [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 16 18:02:27 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 997195776 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:27 user nova-compute[75342]: INFO nova.compute.manager [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Detaching volume c3b705e5-f82d-478d-8b89-e352f0e5a8da
Nov 16 18:02:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:27 user nova-compute[75342]: INFO nova.virt.block_device [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Attempting to driver detach volume c3b705e5-f82d-478d-8b89-e352f0e5a8da from mountpoint /dev/vdb
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Attempting to detach device vdb from instance 65e77fb1-8148-46a5-bc53-139b7ea096ad from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:02:27 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:27 user nova-compute[75342]:   <source dev="/dev/sdl"/>
Nov 16 18:02:27 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:02:27 user nova-compute[75342]:   <serial>c3b705e5-f82d-478d-8b89-e352f0e5a8da</serial>
Nov 16 18:02:27 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 18:02:27 user nova-compute[75342]: </disk>
Nov 16 18:02:27 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:02:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Successfully detached device vdb from instance 65e77fb1-8148-46a5-bc53-139b7ea096ad from the persistent domain config.
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65e77fb1-8148-46a5-bc53-139b7ea096ad from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:02:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:02:27 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:27 user nova-compute[75342]:   <source dev="/dev/sdl"/>
Nov 16 18:02:27 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:02:27 user nova-compute[75342]:   <serial>c3b705e5-f82d-478d-8b89-e352f0e5a8da</serial>
Nov 16 18:02:27 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 18:02:27 user nova-compute[75342]: </disk>
Nov 16 18:02:27 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65e77fb1-8148-46a5-bc53-139b7ea096ad {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:28 user nova-compute[75342]: INFO nova.compute.manager [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Terminating instance
Nov 16 18:02:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMaZWImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:28 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.011s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:28 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Took 1.17 seconds to deallocate network for instance.
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-29001b91-8846-4958-9fc7-faae01c63b0e req-e96e1477-c429-412f-8dac-968af69ae95d service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Received event network-vif-deleted-ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68a0c53-6ce4-45e4-ab69-0f7792c937e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:28 user nova-compute[75342]: No targets found.
Nov 16 18:02:28 user nova-compute[75342]: iSNS:
Nov 16 18:02:28 user nova-compute[75342]: No targets found.
Nov 16 18:02:28 user nova-compute[75342]: STATIC:
Nov 16 18:02:28 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19
Nov 16 18:02:28 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:28 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:28 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:02:28 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:28 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:28 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c
Nov 16 18:02:28 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:28 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:28 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa
Nov 16 18:02:28 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:28 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:28 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b
Nov 16 18:02:28 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:28 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:28 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:28 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:28 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:28 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4
Nov 16 18:02:28 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:28 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:28 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c
Nov 16 18:02:28 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:28 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:28 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da
Nov 16 18:02:28 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:28 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:28 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584
Nov 16 18:02:28 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:28 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:28 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea
Nov 16 18:02:28 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:28 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:28 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:28 user nova-compute[75342]: No targets found.
Nov 16 18:02:28 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:28 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:28 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15153b7-0b11-47f1-85b5-5506b9e89752]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b542e55-c067-4e78-9658-3a549675d8c3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:28 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:28 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:28 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6d9b537f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8873a0ea-4d87-4d2c-bce9-c982a2b105b2]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[df113eb2-8d56-4c64-8e78-d8295b5bea03]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-7c34b2fa-9c76-46a8-9594-60ea85e07971 req-f104470d-8b14-4974-b4f3-cd1e54a4f565 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Received event network-vif-plugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7c34b2fa-9c76-46a8-9594-60ea85e07971 req-f104470d-8b14-4974-b4f3-cd1e54a4f565 service nova] Acquiring lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7c34b2fa-9c76-46a8-9594-60ea85e07971 req-f104470d-8b14-4974-b4f3-cd1e54a4f565 service nova] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7c34b2fa-9c76-46a8-9594-60ea85e07971 req-f104470d-8b14-4974-b4f3-cd1e54a4f565 service nova] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-7c34b2fa-9c76-46a8-9594-60ea85e07971 req-f104470d-8b14-4974-b4f3-cd1e54a4f565 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] No waiting events found dispatching network-vif-plugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:28 user nova-compute[75342]: WARNING nova.compute.manager [req-7c34b2fa-9c76-46a8-9594-60ea85e07971 req-f104470d-8b14-4974-b4f3-cd1e54a4f565 service nova] [instance: e00c5b4b-e155-4513-bda3-7eea536e8742] Received unexpected event network-vif-plugged-ebf8ff34-740f-4344-9caf-aec4d0b51afc for instance with vm_state deleted and task_state None.
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[574479ca-90be-4071-b646-6c4c89f57e3e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8132e300-1a12-4fe2-bbd7-d0b820a192d8]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba3dce-fc92-47c9-97a0-eefa8bf80708]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --logout" returned: 0 in 0.140s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10f028f-3807-40f5-840a-98f8a9598343]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260]
Nov 16 18:02:28 user nova-compute[75342]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:28 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4078113e-064f-40e3-a050-f39a87dc449f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.540s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] <== disconnect_volume: return (552ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:02:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-cde0f108-0167-442d-8895-95d953719fcf req-7f5175bf-25ea-47ff-b514-1c3ee3579246 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-changed-ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-cde0f108-0167-442d-8895-95d953719fcf req-7f5175bf-25ea-47ff-b514-1c3ee3579246 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing instance network info cache due to event network-changed-ff4eefd7-eda6-4556-b56b-12636302e052. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cde0f108-0167-442d-8895-95d953719fcf req-7f5175bf-25ea-47ff-b514-1c3ee3579246 service nova] Acquiring lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cde0f108-0167-442d-8895-95d953719fcf req-7f5175bf-25ea-47ff-b514-1c3ee3579246 service nova] Acquired lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG nova.network.neutron [req-cde0f108-0167-442d-8895-95d953719fcf req-7f5175bf-25ea-47ff-b514-1c3ee3579246 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Refreshing network info cache for port ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.697s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG nova.compute.manager [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKnRMxyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '07c92356-fdd3-4884-b406-55c92c63db18', 'attached_at': '', 'detached_at': '', 'volume_id': '02fa77ca-71f8-462f-977c-a9868c80fd9c', 'serial'} {{(pid=75342) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG nova.compute.manager [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] swap_volume: removing Cinder connection for volume a05c843f-c695-449f-baf7-d4b8559db14c {{(pid=75342) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 18:02:29 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Deleted allocations for instance e00c5b4b-e155-4513-bda3-7eea536e8742
Nov 16 18:02:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-50e5b211-b85d-4c55-965a-3c259882c76c tempest-AttachSCSIVolumeTestJSON-988371779 tempest-AttachSCSIVolumeTestJSON-988371779-project-member] Lock "e00c5b4b-e155-4513-bda3-7eea536e8742" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.421s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG nova.network.neutron [req-cde0f108-0167-442d-8895-95d953719fcf req-7f5175bf-25ea-47ff-b514-1c3ee3579246 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updated VIF entry in instance network info cache for port ff4eefd7-eda6-4556-b56b-12636302e052. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG nova.network.neutron [req-cde0f108-0167-442d-8895-95d953719fcf req-7f5175bf-25ea-47ff-b514-1c3ee3579246 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating instance_info_cache with network_info: [{"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cde0f108-0167-442d-8895-95d953719fcf req-7f5175bf-25ea-47ff-b514-1c3ee3579246 service nova] Releasing lock "refresh_cache-89e3e5a3-2d3c-46d8-b155-3dc429531e00" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:02:30 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Instance destroyed successfully.
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.objects.instance [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lazy-loading 'resources' on Instance uuid 77a26e02-f97e-4911-9dd4-3f6f30d92edc {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "address": "fa:16:3e:b7:a2:ab", "network": {"id": "9355741c-1087-431f-845c-cc54af29620b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-848795901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb611b37d-a0", "ovs_interfaceid": "b611b37d-a062-41de-9792-7a3c5c60cfc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=b611b37d-a062-41de-9792-7a3c5c60cfc4,network=Network(9355741c-1087-431f-845c-cc54af29620b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb611b37d-a0') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=b611b37d-a062-41de-9792-7a3c5c60cfc4,network=Network(9355741c-1087-431f-845c-cc54af29620b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb611b37d-a0') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb611b37d-a0, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] swap_volume: Updating volume a05c843f-c695-449f-baf7-d4b8559db14c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "kKnRMxyo", "auth_password": "ah5wbIFyZJXQfL", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "02fa77ca-71f8-462f-977c-a9868c80fd9c"}, "status": "reserved", "instance": "07c92356-fdd3-4884-b406-55c92c63db18", "attached_at": "", "detached_at": "", "volume_id": "02fa77ca-71f8-462f-977c-a9868c80fd9c", "serial": "02fa77ca-71f8-462f-977c-a9868c80fd9c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '02fa77ca-71f8-462f-977c-a9868c80fd9c', 'no_device': None, 'attachment_id': '318eddeb-4657-4622-a62a-d18aa7933aec'} {{(pid=75342) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4ffedc0-ec48-4142-8f51-402fe5ce4280) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-unplugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:30 user nova-compute[75342]: WARNING nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-b611b37d-a062-41de-9792-7a3c5c60cfc4 for instance with vm_state active and task_state deleting.
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-unplugged-76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-76cba993-b3d2-4572-9717-ed57282839e3 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:30 user nova-compute[75342]: WARNING nova.compute.manager [req-f726245b-ae71-4a0b-94d8-f98df55a925c req-a2977941-d5c0-4350-ba94-0cb27528ed4e service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-76cba993-b3d2-4572-9717-ed57282839e3 for instance with vm_state active and task_state deleting.
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d117e182-02b8-4002-b7f2-cc7db4316c28 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "07c92356-fdd3-4884-b406-55c92c63db18" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.991s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: INFO os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=b611b37d-a062-41de-9792-7a3c5c60cfc4,network=Network(9355741c-1087-431f-845c-cc54af29620b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb611b37d-a0')
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "113082fe-16a5-4f84-9632-ea793bef528a", "address": "fa:16:3e:e3:d6:ad", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113082fe-16", "ovs_interfaceid": "113082fe-16a5-4f84-9632-ea793bef528a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=113082fe-16a5-4f84-9632-ea793bef528a,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap113082fe-16') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=113082fe-16a5-4f84-9632-ea793bef528a,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap113082fe-16') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap113082fe-16, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-113082fe-16a5-4f84-9632-ea793bef528a {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-unplugged-113082fe-16a5-4f84-9632-ea793bef528a {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-113082fe-16a5-4f84-9632-ea793bef528a for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-113082fe-16a5-4f84-9632-ea793bef528a {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-113082fe-16a5-4f84-9632-ea793bef528a {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:30 user nova-compute[75342]: WARNING nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-113082fe-16a5-4f84-9632-ea793bef528a for instance with vm_state active and task_state deleting.
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-unplugged-0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-0c243b55-8e7b-406e-8404-da8441b7d178 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:30 user nova-compute[75342]: WARNING nova.compute.manager [req-be0919ba-edb5-45ee-a178-78463f5e7749 req-82f124dc-e5b9-40a0-8fac-d4a13f21a92d service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-0c243b55-8e7b-406e-8404-da8441b7d178 for instance with vm_state active and task_state deleting.
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70b71bd3-8de3-4d76-af61-45b194e0bc54) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: INFO os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=113082fe-16a5-4f84-9632-ea793bef528a,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap113082fe-16')
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "address": "fa:16:3e:5b:db:b5", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4df0294-42", "ovs_interfaceid": "b4df0294-42bc-4bf2-9eb7-a2e39f845032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:db:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4df0294-42bc-4bf2-9eb7-a2e39f845032,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4df0294-42') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:db:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4df0294-42bc-4bf2-9eb7-a2e39f845032,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4df0294-42') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4df0294-42, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bf47355-0c34-4a19-9942-8bc5e56d5194) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: INFO os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:db:b5,bridge_name='br-int',has_traffic_filtering=True,id=b4df0294-42bc-4bf2-9eb7-a2e39f845032,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb4df0294-42')
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "0c243b55-8e7b-406e-8404-da8441b7d178", "address": "fa:16:3e:7f:90:82", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c243b55-8e", "ovs_interfaceid": "0c243b55-8e7b-406e-8404-da8441b7d178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:90:82,bridge_name='br-int',has_traffic_filtering=True,id=0c243b55-8e7b-406e-8404-da8441b7d178,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c243b55-8e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:90:82,bridge_name='br-int',has_traffic_filtering=True,id=0c243b55-8e7b-406e-8404-da8441b7d178,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c243b55-8e') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c243b55-8e, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a04650b8-f47b-497c-a36e-6e721abac482) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: INFO os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:90:82,bridge_name='br-int',has_traffic_filtering=True,id=0c243b55-8e7b-406e-8404-da8441b7d178,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c243b55-8e')
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "525600ed-9b60-41f1-b353-65ca202dbb85", "address": "fa:16:3e:74:66:a0", "network": {"id": "dfd2e053-82e3-44c9-9762-4f7715fe17f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1324644467", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525600ed-9b", "ovs_interfaceid": "525600ed-9b60-41f1-b353-65ca202dbb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=525600ed-9b60-41f1-b353-65ca202dbb85,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525600ed-9b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=525600ed-9b60-41f1-b353-65ca202dbb85,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525600ed-9b') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap525600ed-9b, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-unplugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:31 user nova-compute[75342]: WARNING nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-b4df0294-42bc-4bf2-9eb7-a2e39f845032 for instance with vm_state active and task_state deleting.
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-unplugged-525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-525600ed-9b60-41f1-b353-65ca202dbb85 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:31 user nova-compute[75342]: WARNING nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-525600ed-9b60-41f1-b353-65ca202dbb85 for instance with vm_state active and task_state deleting.
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-unplugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:31 user nova-compute[75342]: WARNING nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 for instance with vm_state active and task_state deleting.
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:31 user nova-compute[75342]: WARNING nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 for instance with vm_state active and task_state deleting.
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:31 user nova-compute[75342]: WARNING nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 for instance with vm_state active and task_state deleting.
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-unplugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa482ca2-9904-4283-941a-606594b9fa8c req-f922ef55-de3d-422f-96ad-66e3e2b92c12 service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-unplugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a7a721f-4dda-46b9-94be-1e59633a40b2) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: INFO os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=525600ed-9b60-41f1-b353-65ca202dbb85,network=Network(dfd2e053-82e3-44c9-9762-4f7715fe17f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525600ed-9b')
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "76cba993-b3d2-4572-9717-ed57282839e3", "address": "fa:16:3e:f0:e7:b9", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76cba993-b3", "ovs_interfaceid": "76cba993-b3d2-4572-9717-ed57282839e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:b9,bridge_name='br-int',has_traffic_filtering=True,id=76cba993-b3d2-4572-9717-ed57282839e3,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76cba993-b3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:b9,bridge_name='br-int',has_traffic_filtering=True,id=76cba993-b3d2-4572-9717-ed57282839e3,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76cba993-b3') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76cba993-b3, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c42eadd8-b3d0-4d9d-83d7-fcc63c1272f8) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: INFO os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:b9,bridge_name='br-int',has_traffic_filtering=True,id=76cba993-b3d2-4572-9717-ed57282839e3,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76cba993-b3')
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1274283793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1274283793',id=11,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwjb4o3hI608r33VqGffxbpcRTVzZg1YBXrQLzc9+CKz0D75m8lBr7cpVmDdcisQw9Ey44twFL8qisCZheDMUqaGeTMRRWY2lL4tURsz5xRb7rYFbhoLI619iiS87+Llg==',key_name='tempest-keypair-1096573599',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='266d252d115e4d61b5c7830bc4c4b4a7',ramdisk_id='',reservation_id='r-ekvv2fr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-373046117',owner_user_name='tempest-TaggedBootDevicesTest-373046117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276674d90afe48ca96935377dba663ff',uuid=77a26e02-f97e-4911-9dd4-3f6f30d92edc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converting VIF {"id": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "address": "fa:16:3e:93:9b:0e", "network": {"id": "bbede1de-0e66-4275-a098-8def3dea2f5e", "bridge": "br-int", "label": "tempest-device-tagging-net2-678609160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "266d252d115e4d61b5c7830bc4c4b4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4ae8c0-bd", "ovs_interfaceid": "5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:9b:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4ae8c0-bd') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:9b:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4ae8c0-bd') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b4ae8c0-bd, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a1ee608-11ce-4558-8b14-1be7d33d1585) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:31 user nova-compute[75342]: INFO os_vif [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:9b:0e,bridge_name='br-int',has_traffic_filtering=True,id=5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097,network=Network(bbede1de-0e66-4275-a098-8def3dea2f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4ae8c0-bd')
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crQisPpg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:31 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[546b1e7b-34af-4b3b-abb1-b54254f0e7b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:31 user nova-compute[75342]: No targets found.
Nov 16 18:02:31 user nova-compute[75342]: iSNS:
Nov 16 18:02:31 user nova-compute[75342]: No targets found.
Nov 16 18:02:31 user nova-compute[75342]: STATIC:
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:31 user nova-compute[75342]: No targets found.
Nov 16 18:02:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:31 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:31 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f76274-b71d-4c11-9dcf-4b2b453f5a46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c4aa7c-8d63-4fea-b382-9ab486727142]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4636680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19'): ({'sdc'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Removing single pathed devices sdc {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b253f58-b624-4252-ae37-6a2662f974cb]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebe1913-dc41-4bec-92eb-1c0895eb32fe]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Flushing IO for device /dev/sdc {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60fbb58-117c-4d95-ac20-2b415b936190]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19d2f79-6a1d-459d-9cc9-ca899a7952b5]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c38415-d4cd-40ae-8bed-a116d38c6eee]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbf6e6e-b388-4de0-bf85-df48d8acb9e8]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19, portal: 172.16.0.220,3260]
Nov 16 18:02:31 user nova-compute[75342]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "07c92356-fdd3-4884-b406-55c92c63db18" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.utils [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e2262c-ca41-489a-98f8-0bfd89ecbd19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[659fc74b-8f34-4768-9aed-49b3d16a2c4d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[830abefd-373e-4fa1-a68f-2da2a520c12d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] <== disconnect_volume: return (421ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ILyizUov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:31 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4894c-a1d6-4b6c-9a17-fca338240da4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2b9a83-aff8-4a4a-9a5f-00c458cb1b41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed25686-c1c6-4c99-b21c-2cc7cb0bc2c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:31 user nova-compute[75342]: No targets found.
Nov 16 18:02:31 user nova-compute[75342]: iSNS:
Nov 16 18:02:31 user nova-compute[75342]: No targets found.
Nov 16 18:02:31 user nova-compute[75342]: STATIC:
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea
Nov 16 18:02:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:31 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:31 user nova-compute[75342]: No targets found.
Nov 16 18:02:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:31 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:31 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d844b059-a6f7-40c8-bcb8-38ea1013ed54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7a9cfe-7a13-436b-8c30-b2899210794b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:31 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bea5fc-608f-425c-99c6-8e159e481b6f]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.utils [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e7a3b7-e220-4b92-9df2-68f5cac5d010]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:31 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c81b76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584'): ({'sdd'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Removing single pathed devices sdd {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:31 user nova-compute[75342]: INFO nova.compute.manager [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Terminating instance
Nov 16 18:02:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[584e654e-4dda-4d01-8d38-6bb001e1e57d]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.038s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3e6070-e482-4084-bc5a-ec470d388686]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Flushing IO for device /dev/sdd {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: INFO nova.compute.manager [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Swapping volume 02fa77ca-71f8-462f-977c-a9868c80fd9c for a05c843f-c695-449f-baf7-d4b8559db14c
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328fe8a-52e2-45b0-bdff-18ba7f9f5ae2]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a763be-d947-44ea-b570-628fd81bc05d]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[67df656a-260d-4311-ad96-82486f04fcc6]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e86c327-5a14-46b7-a572-99673b86f11e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584, portal: 172.16.0.220,3260]
Nov 16 18:02:32 user nova-compute[75342]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723ba8e7-ee09-4572-82e8-6933d6cee584 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2bf32d-35d9-4518-bf0e-ded603059ae4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] <== disconnect_volume: return (415ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyMONUpI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:32 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3bd85c-9c6a-4436-bb6b-c5b67c6aaeb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:32 user nova-compute[75342]: No targets found.
Nov 16 18:02:32 user nova-compute[75342]: iSNS:
Nov 16 18:02:32 user nova-compute[75342]: No targets found.
Nov 16 18:02:32 user nova-compute[75342]: STATIC:
Nov 16 18:02:32 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:02:32 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:32 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:32 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa
Nov 16 18:02:32 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:32 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:32 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b
Nov 16 18:02:32 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:32 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:32 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:32 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:32 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:32 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4
Nov 16 18:02:32 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:32 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:32 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c
Nov 16 18:02:32 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:32 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:32 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da
Nov 16 18:02:32 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:32 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:32 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea
Nov 16 18:02:32 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:32 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:32 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:32 user nova-compute[75342]: No targets found.
Nov 16 18:02:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:32 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:32 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0c38cd-3a7a-4f72-85f4-36fb5f72ec23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[91596ef6-ef6a-437c-b6ee-6deaa53ee2b1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:32 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c818b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa'): ({'sdf'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Removing single pathed devices sdf {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba90a17-2b16-4691-984c-3fe3d417a241]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdefcef-b9ff-46c1-be40-0ef9a9133778]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Flushing IO for device /dev/sdf {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2c7f87-8ba7-43df-9828-a23a9df0d06d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5650216e-6a18-4d71-aa00-01113a31a2b6]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] SCSI volumes sdf have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55e08a9-b33f-4b07-ac23-7adfb6194b47]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.107s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e993af9a-1102-416f-996e-ea55098d3349]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa, portal: 172.16.0.220,3260]
Nov 16 18:02:32 user nova-compute[75342]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:604406f2-9c75-40a2-8292-531fc9e426fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aff494-ccc3-40a2-97df-a2d882d77fa4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] <== disconnect_volume: return (384ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:32 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Deleting instance files /opt/stack/data/nova/instances/77a26e02-f97e-4911-9dd4-3f6f30d92edc_del
Nov 16 18:02:32 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Deletion of /opt/stack/data/nova/instances/77a26e02-f97e-4911-9dd4-3f6f30d92edc_del complete
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: INFO nova.compute.manager [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Took 4.29 seconds to destroy the instance on the hypervisor.
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-ba01ac93-ec37-4ab7-9566-141ae4a91611 req-5731e0ef-aa76-460b-9f67-a9b72ae664e2 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ba01ac93-ec37-4ab7-9566-141ae4a91611 req-5731e0ef-aa76-460b-9f67-a9b72ae664e2 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ba01ac93-ec37-4ab7-9566-141ae4a91611 req-5731e0ef-aa76-460b-9f67-a9b72ae664e2 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ba01ac93-ec37-4ab7-9566-141ae4a91611 req-5731e0ef-aa76-460b-9f67-a9b72ae664e2 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-ba01ac93-ec37-4ab7-9566-141ae4a91611 req-5731e0ef-aa76-460b-9f67-a9b72ae664e2 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-unplugged-ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-ba01ac93-ec37-4ab7-9566-141ae4a91611 req-5731e0ef-aa76-460b-9f67-a9b72ae664e2 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-ff4eefd7-eda6-4556-b56b-12636302e052 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] Acquiring lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] No waiting events found dispatching network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:33 user nova-compute[75342]: WARNING nova.compute.manager [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received unexpected event network-vif-plugged-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 for instance with vm_state active and task_state deleting.
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-unplugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:33 user nova-compute[75342]: WARNING nova.compute.manager [req-00136747-71c0-4432-9ed8-f6416ef02ba2 req-6c760cd2-7ba8-4664-ad55-92fce93a5fce service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-6af300a9-e32e-4005-bcc0-25cf02d3d478 for instance with vm_state active and task_state deleting.
Nov 16 18:02:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-3d5632bf-4dc1-466e-81e2-d655c8c79c8e req-d2838f9d-5cd9-44e5-b2f4-3adfcec04b29 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d5632bf-4dc1-466e-81e2-d655c8c79c8e req-d2838f9d-5cd9-44e5-b2f4-3adfcec04b29 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d5632bf-4dc1-466e-81e2-d655c8c79c8e req-d2838f9d-5cd9-44e5-b2f4-3adfcec04b29 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d5632bf-4dc1-466e-81e2-d655c8c79c8e req-d2838f9d-5cd9-44e5-b2f4-3adfcec04b29 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-3d5632bf-4dc1-466e-81e2-d655c8c79c8e req-d2838f9d-5cd9-44e5-b2f4-3adfcec04b29 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-unplugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-3d5632bf-4dc1-466e-81e2-d655c8c79c8e req-d2838f9d-5cd9-44e5-b2f4-3adfcec04b29 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Updating instance_info_cache with network_info: [{"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:33 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Instance destroyed successfully.
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.objects.instance [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lazy-loading 'resources' on Instance uuid 89e3e5a3-2d3c-46d8-b155-3dc429531e00 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "ff4eefd7-eda6-4556-b56b-12636302e052", "address": "fa:16:3e:33:37:30", "network": {"id": "e1b81a93-3621-4c71-ad60-d2616fcaa07d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1579832551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff4eefd7-ed", "ovs_interfaceid": "ff4eefd7-eda6-4556-b56b-12636302e052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:37:30,bridge_name='br-int',has_traffic_filtering=True,id=ff4eefd7-eda6-4556-b56b-12636302e052,network=Network(e1b81a93-3621-4c71-ad60-d2616fcaa07d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff4eefd7-ed') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:37:30,bridge_name='br-int',has_traffic_filtering=True,id=ff4eefd7-eda6-4556-b56b-12636302e052,network=Network(e1b81a93-3621-4c71-ad60-d2616fcaa07d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff4eefd7-ed') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff4eefd7-ed, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=174b82bb-6fe7-4dca-8285-9581c5c7350a) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: INFO os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:37:30,bridge_name='br-int',has_traffic_filtering=True,id=ff4eefd7-eda6-4556-b56b-12636302e052,network=Network(e1b81a93-3621-4c71-ad60-d2616fcaa07d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff4eefd7-ed')
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=6af300a9-e32e-4005-bcc0-25cf02d3d478,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af300a9-e3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=6af300a9-e32e-4005-bcc0-25cf02d3d478,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af300a9-e3') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6af300a9-e3, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7563655b-1629-4342-a9b9-a8c1232001e9) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: INFO os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=6af300a9-e32e-4005-bcc0-25cf02d3d478,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6af300a9-e3')
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a6:c5,bridge_name='br-int',has_traffic_filtering=True,id=c58d7330-f3b0-4fe2-8f24-687f27f94b1b,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc58d7330-f3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a6:c5,bridge_name='br-int',has_traffic_filtering=True,id=c58d7330-f3b0-4fe2-8f24-687f27f94b1b,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc58d7330-f3') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc58d7330-f3, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ce80b42-3f51-4732-9ad2-9efddcb49bf0) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: INFO os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a6:c5,bridge_name='br-int',has_traffic_filtering=True,id=c58d7330-f3b0-4fe2-8f24-687f27f94b1b,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc58d7330-f3')
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ee:03,bridge_name='br-int',has_traffic_filtering=True,id=7eb0e0f5-10e0-47fa-85db-40177eec8aed,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb0e0f5-10') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ee:03,bridge_name='br-int',has_traffic_filtering=True,id=7eb0e0f5-10e0-47fa-85db-40177eec8aed,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb0e0f5-10') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7eb0e0f5-10, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7dca451-84c2-4500-add1-6194134362bf) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: INFO os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ee:03,bridge_name='br-int',has_traffic_filtering=True,id=7eb0e0f5-10e0-47fa-85db-40177eec8aed,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb0e0f5-10')
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:8a:04,bridge_name='br-int',has_traffic_filtering=True,id=c3caa036-462f-4be2-b871-21063f9391e6,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3caa036-46') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8a:04,bridge_name='br-int',has_traffic_filtering=True,id=c3caa036-462f-4be2-b871-21063f9391e6,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3caa036-46') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3caa036-46, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c33c6e00-4633-4f71-8d73-8b7907096c1d) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:34 user nova-compute[75342]: WARNING nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-ff4eefd7-eda6-4556-b56b-12636302e052 for instance with vm_state active and task_state deleting.
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-unplugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:34 user nova-compute[75342]: WARNING nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-c58d7330-f3b0-4fe2-8f24-687f27f94b1b for instance with vm_state active and task_state deleting.
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-unplugged-33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-33e085a5-f694-4271-8ac1-76b32841c773 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:34 user nova-compute[75342]: WARNING nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-33e085a5-f694-4271-8ac1-76b32841c773 for instance with vm_state active and task_state deleting.
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-unplugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:34 user nova-compute[75342]: WARNING nova.compute.manager [req-487e26b9-11c0-4e8a-b817-91c6b91580ba req-f39ddd9c-0b61-4e56-b5f5-8a2db9005cbc service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 for instance with vm_state active and task_state deleting.
Nov 16 18:02:34 user nova-compute[75342]: INFO os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8a:04,bridge_name='br-int',has_traffic_filtering=True,id=c3caa036-462f-4be2-b871-21063f9391e6,network=Network(72d751ae-7117-4a97-b171-b5f9cb042170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3caa036-46')
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:5e:99,bridge_name='br-int',has_traffic_filtering=True,id=33e085a5-f694-4271-8ac1-76b32841c773,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e085a5-f6') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:5e:99,bridge_name='br-int',has_traffic_filtering=True,id=33e085a5-f694-4271-8ac1-76b32841c773,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e085a5-f6') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33e085a5-f6, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ec9cc6d-56e0-4358-a019-c311f6e9664f) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: INFO os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:5e:99,bridge_name='br-int',has_traffic_filtering=True,id=33e085a5-f694-4271-8ac1-76b32841c773,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e085a5-f6')
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784670329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784670329',id=12,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnU9NWSC936rEQ7i6GJuBBjtx/+aIkS+r6T7WzXgHsoTn8HnrcqPztIklGBBk3TaitTbWzAcu6ov6j1qPcx/nMJ5kxDpnMMNxKr5JIRB5YJDVxg7gKVSIcMBUl7OQ8pJQ==',key_name='tempest-keypair-1160751919',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5614cdd6149a472b93ac97406fa087ce',ramdisk_id='',reservation_id='r-icutj04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2117807047',owner_user_name='tempest-TaggedBootDevicesTest_v242-2117807047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3904f422a1964577b7ffe40a188034b4',uuid=89e3e5a3-2d3c-46d8-b155-3dc429531e00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converting VIF {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=553cae05-4cfc-4ddb-b0a4-10440f8d02c2,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553cae05-4c') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=553cae05-4cfc-4ddb-b0a4-10440f8d02c2,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553cae05-4c') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap553cae05-4c, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fd53b61-5793-43d7-aeb1-e5fd4ab31ac4) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:34 user nova-compute[75342]: INFO os_vif [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=553cae05-4cfc-4ddb-b0a4-10440f8d02c2,network=Network(e355cf6c-9798-4e80-bf06-a83bb86bb81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap553cae05-4c')
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGqXAmUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:35 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce786bb8-3c29-4e39-a78e-18a455b3dc50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:35 user nova-compute[75342]: No targets found.
Nov 16 18:02:35 user nova-compute[75342]: iSNS:
Nov 16 18:02:35 user nova-compute[75342]: No targets found.
Nov 16 18:02:35 user nova-compute[75342]: STATIC:
Nov 16 18:02:35 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:02:35 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:35 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:35 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b
Nov 16 18:02:35 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:35 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:35 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:35 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:35 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:35 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4
Nov 16 18:02:35 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:35 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:35 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c
Nov 16 18:02:35 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:35 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:35 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da
Nov 16 18:02:35 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:35 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:35 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:35 user nova-compute[75342]: No targets found.
Nov 16 18:02:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:35 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:35 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4152a08-69b3-4204-b0e5-01a52d59732f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53261ec-e59e-424b-bb4d-28c25f763f75]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4630670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c'): ({'sde'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Removing single pathed devices sde {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1ffb77-a476-4015-b8d8-1dcf2c21cf2a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c33f7a-462c-4c0e-82f8-d59f5c4b962b]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Flushing IO for device /dev/sde {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc0f58f-37b7-4189-b1a6-d8ef9a9f2c77]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd08739-07af-4dc2-972b-9a1019bc8383]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-21decb21-f685-4959-8d4a-bf3b904d12dd req-1e5ad496-00a6-4786-81e9-bce7e2f87650 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received event volume-reimaged-e99588c0-6d23-4cdf-b077-4d9d23522cea {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-21decb21-f685-4959-8d4a-bf3b904d12dd req-1e5ad496-00a6-4786-81e9-bce7e2f87650 service nova] Acquiring lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-21decb21-f685-4959-8d4a-bf3b904d12dd req-1e5ad496-00a6-4786-81e9-bce7e2f87650 service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-21decb21-f685-4959-8d4a-bf3b904d12dd req-1e5ad496-00a6-4786-81e9-bce7e2f87650 service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-21decb21-f685-4959-8d4a-bf3b904d12dd req-1e5ad496-00a6-4786-81e9-bce7e2f87650 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Processing event volume-reimaged-e99588c0-6d23-4cdf-b077-4d9d23522cea {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.compute.manager [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[666d37f0-5386-4ed2-8cb8-c194d9cc978a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: INFO nova.virt.block_device [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Booting with volume e99588c0-6d23-4cdf-b077-4d9d23522cea at /dev/vda
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:35 user nova-compute[75342]: WARNING nova.compute.manager [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-7eb0e0f5-10e0-47fa-85db-40177eec8aed for instance with vm_state active and task_state deleting.
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-unplugged-c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-unplugged-c3caa036-462f-4be2-b871-21063f9391e6 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-plugged-c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] Acquiring lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] No waiting events found dispatching network-vif-plugged-c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:35 user nova-compute[75342]: WARNING nova.compute.manager [req-fcaff9aa-192b-4647-b355-43b44c4242a0 req-2b9054c8-c778-4b95-8cb2-093137f481f3 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received unexpected event network-vif-plugged-c3caa036-462f-4be2-b871-21063f9391e6 for instance with vm_state active and task_state deleting.
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[649c7d8e-c606-45a2-aed1-4dbc253218b3]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c, portal: 172.16.0.220,3260]
Nov 16 18:02:35 user nova-compute[75342]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.utils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[653f0371-159e-4da0-accc-de7a6f10cc3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ed6108f-8574-49bc-be9e-1ff3bcf1e56c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e46dad3-bdb7-4e0f-b894-f80a2294eaf8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] <== disconnect_volume: return (481ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkNiKdtE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:35 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[260ca68c-db30-4104-9a6a-7f839988ea3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efdd2c5-0c09-4899-9144-90186820bcc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:35 user nova-compute[75342]: No targets found.
Nov 16 18:02:35 user nova-compute[75342]: iSNS:
Nov 16 18:02:35 user nova-compute[75342]: No targets found.
Nov 16 18:02:35 user nova-compute[75342]: STATIC:
Nov 16 18:02:35 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:02:35 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:35 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:35 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b
Nov 16 18:02:35 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:35 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:35 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:35 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:35 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:35 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4
Nov 16 18:02:35 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:35 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:35 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da
Nov 16 18:02:35 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:35 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:35 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:35 user nova-compute[75342]: No targets found.
Nov 16 18:02:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:35 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:35 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cabe24-170f-4eb0-9664-6d474fa090fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d9c19c-c427-4fa9-b298-3999f9f862ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b55fe64-dd09-4689-aa99-2cfbba260142]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:35 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ab9c89-92c9-4ec8-87f5-a27ac5176a1d]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fdddcd-4f25-41ef-8dc2-d4f82b9d896d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b (non-flash)
Nov 16 18:02:35 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4634ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b'): ({'sdg'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Removing single pathed devices sdg {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.utils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] <== get_connector_properties: return (210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Updating existing volume attachment record: f6c0907a-18d7-487b-a45f-dd67a1c1f0a4 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b309f3b-abb6-4e55-8af0-5f3b982125af]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.029s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[464846be-340d-4a1d-bd3d-43d473f8a80b]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Flushing IO for device /dev/sdg {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a871f562-8f73-4feb-8c20-45fe18a72828]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.060s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec117b49-0897-49f3-9566-253e59b6ee6b]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] SCSI volumes sdg have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[676e89f2-2d32-4854-afa3-629d61212f4a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21cc32e-c18f-4254-a45a-86bff431811c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b, portal: 172.16.0.220,3260]
Nov 16 18:02:35 user nova-compute[75342]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb621983-7294-4b66-b3ce-0ed6d8fe156b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[65041acb-31b1-49b4-a160-684630fd2e3e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.510s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] <== disconnect_volume: return (513ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEWNsMGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:36 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c087297-c734-4cf9-bf89-1984344f7dcf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:36 user nova-compute[75342]: No targets found.
Nov 16 18:02:36 user nova-compute[75342]: iSNS:
Nov 16 18:02:36 user nova-compute[75342]: No targets found.
Nov 16 18:02:36 user nova-compute[75342]: STATIC:
Nov 16 18:02:36 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa
Nov 16 18:02:36 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:36 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:36 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:36 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:36 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:36 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4
Nov 16 18:02:36 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:36 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:36 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da
Nov 16 18:02:36 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:36 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:36 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:36 user nova-compute[75342]: No targets found.
Nov 16 18:02:36 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:36 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:36 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc5139c-aeec-4059-ab2d-b90ec403f543]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b139ccf-d7f6-4d1d-aa9d-353ec2f6d10a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:36 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:36 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:36 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:36 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:36 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:36 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:36 user nova-compute[75342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa (non-flash)
Nov 16 18:02:36 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4630940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa'): ({'sdh'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Removing single pathed devices sdh {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6514daf2-dd2d-4d5e-9d14-3e8151c7a9ab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62d28be-b0e0-43d8-9eda-06a09e543566]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Flushing IO for device /dev/sdh {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5003fca7-6db5-48db-966b-48682d130a0e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c891ed8-acd8-45fc-a706-3056fd5ac8ec]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] SCSI volumes sdh have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f2c082-dcde-47eb-9fbe-12aae05eeea8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaf0bb7-998c-4337-96ae-a2c468861af2]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa, portal: 172.16.0.220,3260]
Nov 16 18:02:36 user nova-compute[75342]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:36 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a9e17e-0e24-4729-bd1d-66c9d7cafefa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57cd6ac-b423-4fbe-b01b-cb630e7fee52]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] <== disconnect_volume: return (370ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Deleting instance files /opt/stack/data/nova/instances/89e3e5a3-2d3c-46d8-b155-3dc429531e00_del
Nov 16 18:02:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Deletion of /opt/stack/data/nova/instances/89e3e5a3-2d3c-46d8-b155-3dc429531e00_del complete
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: INFO nova.compute.manager [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Took 4.67 seconds to destroy the instance on the hypervisor.
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:37 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Took 4.62 seconds to deallocate network for instance.
Nov 16 18:02:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-bd38adde-4193-47c4-a4e0-993bcfe14551 req-87f7dfec-9fa3-4115-8b22-59e595ae895b service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-deleted-b611b37d-a062-41de-9792-7a3c5c60cfc4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-bd38adde-4193-47c4-a4e0-993bcfe14551 req-87f7dfec-9fa3-4115-8b22-59e595ae895b service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-deleted-76cba993-b3d2-4572-9717-ed57282839e3 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-bd38adde-4193-47c4-a4e0-993bcfe14551 req-87f7dfec-9fa3-4115-8b22-59e595ae895b service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-deleted-0c243b55-8e7b-406e-8404-da8441b7d178 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-bd38adde-4193-47c4-a4e0-993bcfe14551 req-87f7dfec-9fa3-4115-8b22-59e595ae895b service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-deleted-5b4ae8c0-bdd6-4aa7-a6d1-8a31d143d097 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-bd38adde-4193-47c4-a4e0-993bcfe14551 req-87f7dfec-9fa3-4115-8b22-59e595ae895b service nova] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Received event network-vif-deleted-525600ed-9b60-41f1-b353-65ca202dbb85 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:37 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid '89e3e5a3-2d3c-46d8-b155-3dc429531e00' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid '89e3e5a3-2d3c-46d8-b155-3dc429531e00' (instance-0000000c)
Nov 16 18:02:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:37 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:02:37 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:02:37 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7719MB free_disk=25.525096893310547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 2992b5fc-86e6-425f-82e5-cf6358582872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance a04eb165-88b6-4826-a4ac-c1bc51a57ba5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 07c92356-fdd3-4884-b406-55c92c63db18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 65e77fb1-8148-46a5-bc53-139b7ea096ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d057c823-fd25-45f9-ba3e-11a784f38064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 77a26e02-f97e-4911-9dd4-3f6f30d92edc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 89e3e5a3-2d3c-46d8-b155-3dc429531e00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:02:38 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d057c823-fd25-45f9-ba3e-11a784f38064 is timed out.
Nov 16 18:02:38 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Successfully detached device vdb from instance d057c823-fd25-45f9-ba3e-11a784f38064 from the live domain config.
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRihFtIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:38 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adc7c39-4233-4b6d-bd37-1cee4465f577]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:38 user nova-compute[75342]: No targets found.
Nov 16 18:02:38 user nova-compute[75342]: iSNS:
Nov 16 18:02:38 user nova-compute[75342]: No targets found.
Nov 16 18:02:38 user nova-compute[75342]: STATIC:
Nov 16 18:02:38 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:38 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:38 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:38 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4
Nov 16 18:02:38 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:38 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:38 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da
Nov 16 18:02:38 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:38 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:38 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:38 user nova-compute[75342]: No targets found.
Nov 16 18:02:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:38 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:38 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db10a30-b1cf-45d4-949e-3452ab0f3f53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd08b45f-3a6e-4366-ab9c-0f132b883457]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:38 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:38 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 (non-flash)
Nov 16 18:02:38 user nova-compute[75342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:38 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a46328c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4'): ({'sdk'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Removing single pathed devices sdk {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26abb26-8602-409b-9882-2978b45aa79f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2c26ef-77e3-4dee-9067-819077feecf8]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Flushing IO for device /dev/sdk {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabc78ee-8079-428f-8425-0d1cc8adbe65]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.048s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[27050255-e6d8-4f2b-9a47-e63241117021]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] SCSI volumes sdk have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fa3dff-ed27-4f2b-b495-8e97cfa44d5f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a91d601-d646-4924-ab25-def5f3662390]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4, portal: 172.16.0.220,3260]
Nov 16 18:02:38 user nova-compute[75342]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bacc29-21da-4144-a2e5-c6e4fd4718c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e323c642-2e3d-42b9-b704-522ff761c1e2]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] <== disconnect_volume: return (325ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-ba4f4061-cc65-411a-a2b3-3d7f0e30bf78 req-7dbaa883-907c-4853-b70e-ea00edc6f315 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-deleted-ff4eefd7-eda6-4556-b56b-12636302e052 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:39 user nova-compute[75342]: INFO nova.compute.manager [req-ba4f4061-cc65-411a-a2b3-3d7f0e30bf78 req-7dbaa883-907c-4853-b70e-ea00edc6f315 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Neutron deleted interface ff4eefd7-eda6-4556-b56b-12636302e052; detaching it from the instance and deleting it from the info cache
Nov 16 18:02:39 user nova-compute[75342]: DEBUG nova.network.neutron [req-ba4f4061-cc65-411a-a2b3-3d7f0e30bf78 req-7dbaa883-907c-4853-b70e-ea00edc6f315 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating instance_info_cache with network_info: [{"id": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "address": "fa:16:3e:10:c0:d0", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af300a9-e3", "ovs_interfaceid": "6af300a9-e32e-4005-bcc0-25cf02d3d478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "address": "fa:16:3e:66:a6:c5", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58d7330-f3", "ovs_interfaceid": "c58d7330-f3b0-4fe2-8f24-687f27f94b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "address": "fa:16:3e:a4:ee:03", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb0e0f5-10", "ovs_interfaceid": "7eb0e0f5-10e0-47fa-85db-40177eec8aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3caa036-462f-4be2-b871-21063f9391e6", "address": "fa:16:3e:64:8a:04", "network": {"id": "72d751ae-7117-4a97-b171-b5f9cb042170", "bridge": "br-int", "label": "tempest-device-tagging-net1-624785760", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3caa036-46", "ovs_interfaceid": "c3caa036-462f-4be2-b871-21063f9391e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33e085a5-f694-4271-8ac1-76b32841c773", "address": "fa:16:3e:63:5e:99", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e085a5-f6", "ovs_interfaceid": "33e085a5-f694-4271-8ac1-76b32841c773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "address": "fa:16:3e:08:ab:71", "network": {"id": "e355cf6c-9798-4e80-bf06-a83bb86bb81d", "bridge": "br-int", "label": "tempest-device-tagging-net2-75266025", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5614cdd6149a472b93ac97406fa087ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap553cae05-4c", "ovs_interfaceid": "553cae05-4cfc-4ddb-b0a4-10440f8d02c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-ba4f4061-cc65-411a-a2b3-3d7f0e30bf78 req-7dbaa883-907c-4853-b70e-ea00edc6f315 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Detach interface failed, port_id=ff4eefd7-eda6-4556-b56b-12636302e052, reason: Instance 89e3e5a3-2d3c-46d8-b155-3dc429531e00 could not be found. {{(pid=75342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 18:02:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:40 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:40 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Took 4.47 seconds to deallocate network for instance.
Nov 16 18:02:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-0411dc27-4591-4f8a-9671-314afc03104c req-0a29dcd1-a937-40b6-9e6f-11e319c8eda4 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-deleted-7eb0e0f5-10e0-47fa-85db-40177eec8aed {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-0411dc27-4591-4f8a-9671-314afc03104c req-0a29dcd1-a937-40b6-9e6f-11e319c8eda4 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-deleted-553cae05-4cfc-4ddb-b0a4-10440f8d02c2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-0411dc27-4591-4f8a-9671-314afc03104c req-0a29dcd1-a937-40b6-9e6f-11e319c8eda4 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-deleted-33e085a5-f694-4271-8ac1-76b32841c773 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-0411dc27-4591-4f8a-9671-314afc03104c req-0a29dcd1-a937-40b6-9e6f-11e319c8eda4 service nova] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Received event network-vif-deleted-c3caa036-462f-4be2-b871-21063f9391e6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMaZWImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07c92356-fdd3-4884-b406-55c92c63db18', 'attached_at': '', 'detached_at': '', 'volume_id': 'a05c843f-c695-449f-baf7-d4b8559db14c', 'serial': 'a05c843f-c695-449f-baf7-d4b8559db14c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKnRMxyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '02fa77ca-71f8-462f-977c-a9868c80fd9c'}, 'status': 'reserved', 'instance': '07c92356-fdd3-4884-b406-55c92c63db18', 'attached_at': '', 'detached_at': '', 'volume_id': '02fa77ca-71f8-462f-977c-a9868c80fd9c', 'serial'} {{(pid=75342) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMaZWImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:41 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:41 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:41 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[861e5306-c272-4642-a7bc-5aea66968230]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:02:41 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9607f5-ae13-4170-b321-6f1932e314f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c] added
Nov 16 18:02:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e27981-1c5c-4239-9170-429d6ef1bd68]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c109ff1-9f67-4cee-a07a-4525b7d3f706]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMaZWImv {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMaZWImv" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee95e10-ae2f-4df4-a0c6-25b6f3072865]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EMaZWImv'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[da640a17-0a7a-478e-bc20-d4a321d4260a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f395e8-4326-4e1e-b286-9343f2f0da34]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:41 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:41 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43ea907-abc7-405d-930f-12af575a0fd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260]
Nov 16 18:02:41 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdc08d2-0107-42b1-8c8f-01c1ed8d0728]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[299f9362-0225-47b0-8ac9-a4e16c8c70b2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:41 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:41 user nova-compute[75342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:41 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:41 user nova-compute[75342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc18de4e-a694-4e92-9b62-7d21350c59ae]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.objects.instance [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lazy-loading 'flavor' on Instance uuid d057c823-fd25-45f9-ba3e-11a784f38064 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2602807f-ec24-4bb2-90b6-ad42a441ce56 tempest-VolumesAssistedSnapshotsTest-1021967107 tempest-VolumesAssistedSnapshotsTest-1021967107-project-admin] Lock "d057c823-fd25-45f9-ba3e-11a784f38064" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.277s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:02:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Creating image(s)
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Ensure instance console log exists: /opt/stack/data/nova/instances/a04eb165-88b6-4826-a4ac-c1bc51a57ba5/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Start _get_guest_xml network_info=[{"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f6c0907a-18d7-487b-a45f-dd67a1c1f0a4', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWYftGCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a04eb165-88b6-4826-a4ac-c1bc51a57ba5', 'attached_at': '', 'detached_at': '', 'volume_id': 'e99588c0-6d23-4cdf-b077-4d9d23522cea', 'serial': 'e99588c0-6d23-4cdf-b077-4d9d23522cea'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:02:42 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 18:02:42 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.objects.instance [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lazy-loading 'vcpu_model' on Instance uuid a04eb165-88b6-4826-a4ac-c1bc51a57ba5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWYftGCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:42 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMaZWImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23532613663643564', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532613663643564', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.010s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:42 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:42 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG nova.objects.instance [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lazy-loading 'flavor' on Instance uuid 07c92356-fdd3-4884-b406-55c92c63db18 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f21fccb-ca80-43ad-bf96-9ea7c9a6bd90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:02:42 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8da0c1-55cf-4d2c-8d2a-2c394bc916a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea] added
Nov 16 18:02:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abcf8a1-1717-4b8c-9ec8-6be05dd51814]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c420c302-9b68-41b7-bee8-9f5d32eb1149]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWYftGCr {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWYftGCr" returned: 0 in 0.068s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e620041a-3df2-4cd2-be43-1590ab1efe56]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PWYftGCr'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f782ba2-1c85-4974-8f30-8deb07dcbdd3]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0506ead4-f818-4223-88cf-81e615194a64]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:43 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:43 user nova-compute[75342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:43 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:43 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:43 user nova-compute[75342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:43 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d6433a-9833-4e1a-9ee9-933548c6baab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260]
Nov 16 18:02:43 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:43 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[78059f53-fd3a-4fb7-a66e-f650e9cb0e86]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea2835b-f0bb-4497-9b98-1b78fd3f22df]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:43 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:43 user nova-compute[75342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:43 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:43 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:43 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:43 user nova-compute[75342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:43 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:43 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2927d706-07e5-463d-9b9c-124404016996]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWYftGCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:02:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 46137344 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26663653135633035', 'path': '/dev/sdc'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663653135633035', 'path': '/dev/sdc'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1210781846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1419826400',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2YBWpL94rC07MMzLKaBsNk11Qeq2JUeq4m7GthUjfbOD5heJ9mYXBMqIg2uamJMvflvGY3eC+tTt19WLMkmpw0VhnB/T+nyASoArfoa2sGiszErzJ01aVT1fJwxYOKpw==',key_name='tempest-keypair-690867906',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fea851a0954345a0b6a29f5fa178f476',ramdisk_id='',reservation_id='r-utzjni68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-439717470',owner_user_name='tempest-ServerActionsV293TestJSON-439717470-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2efbe29024457cb872f32e561f0a21',uuid=a04eb165-88b6-4826-a4ac-c1bc51a57ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converting VIF {"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:02:44 user nova-compute[75342]:   <uuid>a04eb165-88b6-4826-a4ac-c1bc51a57ba5</uuid>
Nov 16 18:02:44 user nova-compute[75342]:   <name>instance-00000007</name>
Nov 16 18:02:44 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:02:44 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:02:44 user nova-compute[75342]:   <metadata>
Nov 16 18:02:44 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:02:44 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:02:44 user nova-compute[75342]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1210781846</nova:name>
Nov 16 18:02:44 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:02:42</nova:creationTime>
Nov 16 18:02:44 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:02:44 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:02:44 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:02:44 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:02:44 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:02:44 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:02:44 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:02:44 user nova-compute[75342]:       <nova:owner>
Nov 16 18:02:44 user nova-compute[75342]:         <nova:user uuid="ca2efbe29024457cb872f32e561f0a21">tempest-ServerActionsV293TestJSON-439717470-project-member</nova:user>
Nov 16 18:02:44 user nova-compute[75342]:         <nova:project uuid="fea851a0954345a0b6a29f5fa178f476">tempest-ServerActionsV293TestJSON-439717470</nova:project>
Nov 16 18:02:44 user nova-compute[75342]:       </nova:owner>
Nov 16 18:02:44 user nova-compute[75342]:       <nova:ports>
Nov 16 18:02:44 user nova-compute[75342]:         <nova:port uuid="90e051e5-17e8-4b97-92c4-2bd190722aa7">
Nov 16 18:02:44 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 18:02:44 user nova-compute[75342]:         </nova:port>
Nov 16 18:02:44 user nova-compute[75342]:       </nova:ports>
Nov 16 18:02:44 user nova-compute[75342]:     </nova:instance>
Nov 16 18:02:44 user nova-compute[75342]:   </metadata>
Nov 16 18:02:44 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:02:44 user nova-compute[75342]:     <system>
Nov 16 18:02:44 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:02:44 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:02:44 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:02:44 user nova-compute[75342]:       <entry name="serial">a04eb165-88b6-4826-a4ac-c1bc51a57ba5</entry>
Nov 16 18:02:44 user nova-compute[75342]:       <entry name="uuid">a04eb165-88b6-4826-a4ac-c1bc51a57ba5</entry>
Nov 16 18:02:44 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:02:44 user nova-compute[75342]:     </system>
Nov 16 18:02:44 user nova-compute[75342]:   </sysinfo>
Nov 16 18:02:44 user nova-compute[75342]:   <os>
Nov 16 18:02:44 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:02:44 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:02:44 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:02:44 user nova-compute[75342]:   </os>
Nov 16 18:02:44 user nova-compute[75342]:   <features>
Nov 16 18:02:44 user nova-compute[75342]:     <acpi/>
Nov 16 18:02:44 user nova-compute[75342]:     <apic/>
Nov 16 18:02:44 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:02:44 user nova-compute[75342]:   </features>
Nov 16 18:02:44 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:02:44 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:02:44 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:02:44 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:02:44 user nova-compute[75342]:   </clock>
Nov 16 18:02:44 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:02:44 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:02:44 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:02:44 user nova-compute[75342]:   </cpu>
Nov 16 18:02:44 user nova-compute[75342]:   <devices>
Nov 16 18:02:44 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:02:44 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:44 user nova-compute[75342]:       <source dev="/dev/sdc"/>
Nov 16 18:02:44 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:02:44 user nova-compute[75342]:       <serial>e99588c0-6d23-4cdf-b077-4d9d23522cea</serial>
Nov 16 18:02:44 user nova-compute[75342]:     </disk>
Nov 16 18:02:44 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:02:44 user nova-compute[75342]:       <mac address="fa:16:3e:ff:fd:18"/>
Nov 16 18:02:44 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:02:44 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:02:44 user nova-compute[75342]:       <target dev="tap90e051e5-17"/>
Nov 16 18:02:44 user nova-compute[75342]:     </interface>
Nov 16 18:02:44 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:02:44 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/a04eb165-88b6-4826-a4ac-c1bc51a57ba5/console.log" append="off"/>
Nov 16 18:02:44 user nova-compute[75342]:     </serial>
Nov 16 18:02:44 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:02:44 user nova-compute[75342]:     <video>
Nov 16 18:02:44 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:02:44 user nova-compute[75342]:     </video>
Nov 16 18:02:44 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:02:44 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:02:44 user nova-compute[75342]:     </rng>
Nov 16 18:02:44 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:02:44 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:02:44 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:02:44 user nova-compute[75342]:     </memballoon>
Nov 16 18:02:44 user nova-compute[75342]:   </devices>
Nov 16 18:02:44 user nova-compute[75342]: </domain>
Nov 16 18:02:44 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1210781846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1419826400',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2YBWpL94rC07MMzLKaBsNk11Qeq2JUeq4m7GthUjfbOD5heJ9mYXBMqIg2uamJMvflvGY3eC+tTt19WLMkmpw0VhnB/T+nyASoArfoa2sGiszErzJ01aVT1fJwxYOKpw==',key_name='tempest-keypair-690867906',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fea851a0954345a0b6a29f5fa178f476',ramdisk_id='',reservation_id='r-utzjni68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-439717470',owner_user_name='tempest-ServerActionsV293TestJSON-439717470-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2efbe29024457cb872f32e561f0a21',uuid=a04eb165-88b6-4826-a4ac-c1bc51a57ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converting VIF {"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG os_vif [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad9a6805-b516-57d8-bcb3-61ab930efe14', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90e051e5-17, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90e051e5-17, col_values=(('qos', UUID('6b05ee02-9c75-45c0-90b2-f1795cd1e888')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90e051e5-17, col_values=(('external_ids', {'iface-id': '90e051e5-17e8-4b97-92c4-2bd190722aa7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:fd:18', 'vm-uuid': 'a04eb165-88b6-4826-a4ac-c1bc51a57ba5'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:44 user nova-compute[75342]: INFO os_vif [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17')
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 91226112 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] No VIF found with MAC fa:16:3e:ff:fd:18, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:02:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:44 user nova-compute[75342]: INFO nova.compute.manager [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] [instance: 77a26e02-f97e-4911-9dd4-3f6f30d92edc] Took 7.74 seconds to detach 3 volumes for instance.
Nov 16 18:02:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:02:45 user nova-compute[75342]: INFO nova.compute.claims [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Claim successful on node user
Nov 16 18:02:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 198180864 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 331350016 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.613s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.601s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:02:45 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:02:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:02:45 user nova-compute[75342]: DEBUG nova.policy [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13beba5fa97a448fa863135a45e47cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542bb854a1647618ba3995c4342109a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:02:45 user nova-compute[75342]: INFO nova.virt.block_device [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Booting with blank volume at /dev/vda
Nov 16 18:02:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 408944640 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.705s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:46 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Deleted allocations for instance 77a26e02-f97e-4911-9dd4-3f6f30d92edc
Nov 16 18:02:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-ae47275b-bb41-4347-a72b-df7d23abe053 req-c4db17e3-7d2b-45fa-aaf6-7a7a76da84ea service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received event network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ae47275b-bb41-4347-a72b-df7d23abe053 req-c4db17e3-7d2b-45fa-aaf6-7a7a76da84ea service nova] Acquiring lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ae47275b-bb41-4347-a72b-df7d23abe053 req-c4db17e3-7d2b-45fa-aaf6-7a7a76da84ea service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ae47275b-bb41-4347-a72b-df7d23abe053 req-c4db17e3-7d2b-45fa-aaf6-7a7a76da84ea service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-ae47275b-bb41-4347-a72b-df7d23abe053 req-c4db17e3-7d2b-45fa-aaf6-7a7a76da84ea service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] No waiting events found dispatching network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:46 user nova-compute[75342]: WARNING nova.compute.manager [req-ae47275b-bb41-4347-a72b-df7d23abe053 req-c4db17e3-7d2b-45fa-aaf6-7a7a76da84ea service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received unexpected event network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 18:02:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-64266907-532e-4ebc-9c1b-451d7d504d8b tempest-TaggedBootDevicesTest-373046117 tempest-TaggedBootDevicesTest-373046117-project-member] Lock "77a26e02-f97e-4911-9dd4-3f6f30d92edc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.202s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 416284672 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Successfully created port: 3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 450887680 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Successfully updated port: 3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquired lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-91a0c04f-b941-49a4-8e9e-9efce933b598 req-a4730b81-e64c-49cb-a6ff-200a9681be3c service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-changed-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-91a0c04f-b941-49a4-8e9e-9efce933b598 req-a4730b81-e64c-49cb-a6ff-200a9681be3c service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Refreshing instance network info cache due to event network-changed-3412866c-1a34-4be9-91b5-37959486c6cc. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-91a0c04f-b941-49a4-8e9e-9efce933b598 req-a4730b81-e64c-49cb-a6ff-200a9681be3c service nova] Acquiring lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 521142272 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Updating instance_info_cache with network_info: [{"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Releasing lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Instance network_info: |[{"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-91a0c04f-b941-49a4-8e9e-9efce933b598 req-a4730b81-e64c-49cb-a6ff-200a9681be3c service nova] Acquired lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG nova.network.neutron [req-91a0c04f-b941-49a4-8e9e-9efce933b598 req-a4730b81-e64c-49cb-a6ff-200a9681be3c service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Refreshing network info cache for port 3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 676331520 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:48 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 65e77fb1-8148-46a5-bc53-139b7ea096ad is timed out.
Nov 16 18:02:48 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Successfully detached device vdb from instance 65e77fb1-8148-46a5-bc53-139b7ea096ad from the live domain config.
Nov 16 18:02:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WFsTLHBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:48 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[53696587-af54-410f-96ca-a20b71e9b0b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:48 user nova-compute[75342]: No targets found.
Nov 16 18:02:48 user nova-compute[75342]: iSNS:
Nov 16 18:02:48 user nova-compute[75342]: No targets found.
Nov 16 18:02:48 user nova-compute[75342]: STATIC:
Nov 16 18:02:48 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c
Nov 16 18:02:48 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:48 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:48 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:48 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:48 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:48 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da
Nov 16 18:02:48 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:48 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:48 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea
Nov 16 18:02:48 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:48 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:48 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:48 user nova-compute[75342]: No targets found.
Nov 16 18:02:48 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:48 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:48 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc781a4-36b5-44ee-bf1a-bfb612e20613]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[448a6dfa-1b6d-44ca-a9d8-5bdca8b75829]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:48 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:48 user nova-compute[75342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:48 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:48 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:48 user nova-compute[75342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da (non-flash)
Nov 16 18:02:48 user nova-compute[75342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:48 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:48 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6d13d7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da'): ({'sdl'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Removing single pathed devices sdl {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[606400e5-2819-48e0-a5bf-b07acb21ef8b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[830eb77c-80cd-45db-be0a-238a1b55aeca]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Flushing IO for device /dev/sdl {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1622a7-3b24-467b-85a4-e19518d86b7e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-b8e72eb8-82d1-471d-8dce-751da177b5b9 req-cee10e6e-e1a6-4d93-822e-b23138aec8e6 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received event network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b8e72eb8-82d1-471d-8dce-751da177b5b9 req-cee10e6e-e1a6-4d93-822e-b23138aec8e6 service nova] Acquiring lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b8e72eb8-82d1-471d-8dce-751da177b5b9 req-cee10e6e-e1a6-4d93-822e-b23138aec8e6 service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b8e72eb8-82d1-471d-8dce-751da177b5b9 req-cee10e6e-e1a6-4d93-822e-b23138aec8e6 service nova] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-b8e72eb8-82d1-471d-8dce-751da177b5b9 req-cee10e6e-e1a6-4d93-822e-b23138aec8e6 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] No waiting events found dispatching network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:48 user nova-compute[75342]: WARNING nova.compute.manager [req-b8e72eb8-82d1-471d-8dce-751da177b5b9 req-cee10e6e-e1a6-4d93-822e-b23138aec8e6 service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received unexpected event network-vif-plugged-90e051e5-17e8-4b97-92c4-2bd190722aa7 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.056s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d757dd-38d6-46b6-98d0-cf653e433bac]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] SCSI volumes sdl have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb68dfb-166a-4120-bfb2-669788837f03]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 804257792 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ef0ab5-9a9d-49ed-9e9c-ae3663857b7b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da, portal: 172.16.0.220,3260]
Nov 16 18:02:48 user nova-compute[75342]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:48 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b705e5-f82d-478d-8b89-e352f0e5a8da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f9d528-aa7d-4c5d-a36f-5148d20a1e9e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] <== disconnect_volume: return (450ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.network.neutron [req-91a0c04f-b941-49a4-8e9e-9efce933b598 req-a4730b81-e64c-49cb-a6ff-200a9681be3c service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Updated VIF entry in instance network info cache for port 3412866c-1a34-4be9-91b5-37959486c6cc. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.network.neutron [req-91a0c04f-b941-49a4-8e9e-9efce933b598 req-a4730b81-e64c-49cb-a6ff-200a9681be3c service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Updating instance_info_cache with network_info: [{"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-91a0c04f-b941-49a4-8e9e-9efce933b598 req-a4730b81-e64c-49cb-a6ff-200a9681be3c service nova] Releasing lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:02:49 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Instance spawned successfully.
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 922746880 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:49 user nova-compute[75342]: INFO nova.compute.manager [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] [instance: 89e3e5a3-2d3c-46d8-b155-3dc429531e00] Took 8.21 seconds to detach 3 volumes for instance.
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 1029701632 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.364s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:49 user nova-compute[75342]: DEBUG nova.objects.instance [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75342) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 18:02:49 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Deleted allocations for instance 89e3e5a3-2d3c-46d8-b155-3dc429531e00
Nov 16 18:02:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-21decb21-f685-4959-8d4a-bf3b904d12dd tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.144s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-85fe3158-ff91-43b7-8d16-a54a0d295b1d tempest-TaggedBootDevicesTest_v242-2117807047 tempest-TaggedBootDevicesTest_v242-2117807047-project-member] Lock "89e3e5a3-2d3c-46d8-b155-3dc429531e00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.207s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKnRMxyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '02fa77ca-71f8-462f-977c-a9868c80fd9c'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:50 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.objects.instance [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lazy-loading 'flavor' on Instance uuid 65e77fb1-8148-46a5-bc53-139b7ea096ad {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4714d8c-7a63-44f8-853e-6178e2387996]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:02:50 user nova-compute[75342]: No targets found.
Nov 16 18:02:50 user nova-compute[75342]: iSNS:
Nov 16 18:02:50 user nova-compute[75342]: No targets found.
Nov 16 18:02:50 user nova-compute[75342]: STATIC:
Nov 16 18:02:50 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c
Nov 16 18:02:50 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:50 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:50 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c
Nov 16 18:02:50 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:50 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:50 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea
Nov 16 18:02:50 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:02:50 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:02:50 user nova-compute[75342]: FIRMWARE:
Nov 16 18:02:50 user nova-compute[75342]: No targets found.
Nov 16 18:02:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:02:50 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:02:50 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[127e6ba8-0175-45d5-a3aa-103c0bb10e2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:02:50 user nova-compute[75342]: INFO nova.compute.claims [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Claim successful on node user
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a708b522-37cf-4f18-a307-81c437ae1b91]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:50 user nova-compute[75342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:50 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c (non-flash)
Nov 16 18:02:50 user nova-compute[75342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:50 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c81b79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c'): ({'sdi'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Removing single pathed devices sdi {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7767e9-9363-4172-86cc-871ad48a2819]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4d628ee8-c82f-4b2b-92f7-7afe53910de6 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.744s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[958bcac2-1ad8-4f5f-95a5-25f07b4a93ca]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Flushing IO for device /dev/sdi {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e115e9a4-0e30-4cf5-9c43-1c494dd26940]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[825f1fd1-57cb-4389-aa41-36503a469faf]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] SCSI volumes sdi have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd473ed-a375-4c25-a921-86af1701bb40]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d74e7e-9872-4690-a6a4-fabbe2a75961]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c, portal: 172.16.0.220,3260]
Nov 16 18:02:50 user nova-compute[75342]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "interface-65e77fb1-8148-46a5-bc53-139b7ea096ad-e1665c78-8646-4a63-ac74-63d44bb0295a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "interface-65e77fb1-8148-46a5-bc53-139b7ea096ad-e1665c78-8646-4a63-ac74-63d44bb0295a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02fa77ca-71f8-462f-977c-a9868c80fd9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c927f0c2-82aa-4093-934f-716a14eb90d5]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] <== disconnect_volume: return (345ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.objects.instance [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lazy-loading 'flavor' on Instance uuid 65e77fb1-8148-46a5-bc53-139b7ea096ad {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1632151976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1632151976',id=9,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzlRPxa4PAPm45PMmq6l0+fBK9hV73ZL6geqM+y/RLFGg/C77lh7irpPP6ckBjAuzTfCveRgeMZjCC7DsaDkkVKcV+qSujYvT8RzL81EPVckf4RjSVpsZxqrwxx8lsoJw==',key_name='tempest-keypair-1617085374',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4063aba08ce4f1d9c22413cc4ac2775',ramdisk_id='',reservation_id='r-ilc0wgmz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1574754300',owner_user_name='tempest-TaggedAttachmentsTest-1574754300-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61915f003d41a4828ba719c2cfd0a2',uuid=65e77fb1-8148-46a5-bc53-139b7ea096ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1665c78-8646-4a63-ac74-63d44bb0295a", "address": "fa:16:3e:a9:61:19", "network": {"id": "4cecbd03-4fda-4d73-a448-79b6109f21c5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-725026521", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1665c78-86", "ovs_interfaceid": "e1665c78-8646-4a63-ac74-63d44bb0295a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converting VIF {"id": "e1665c78-8646-4a63-ac74-63d44bb0295a", "address": "fa:16:3e:a9:61:19", "network": {"id": "4cecbd03-4fda-4d73-a448-79b6109f21c5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-725026521", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1665c78-86", "ovs_interfaceid": "e1665c78-8646-4a63-ac74-63d44bb0295a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:61:19,bridge_name='br-int',has_traffic_filtering=True,id=e1665c78-8646-4a63-ac74-63d44bb0295a,network=Network(4cecbd03-4fda-4d73-a448-79b6109f21c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1665c78-86') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a9:61:19"/><model type="virtio"/><mtu size="1442"/><target dev="tape1665c78-86"/></interface> {{(pid=75342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMaZWImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '07c92356-fdd3-4884-b406-55c92c63db18', 'attached_at': '', 'detached_at': '', 'volume_id': 'a05c843f-c695-449f-baf7-d4b8559db14c', 'serial'} {{(pid=75342) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] swap_volume: removing Cinder connection for volume 02fa77ca-71f8-462f-977c-a9868c80fd9c {{(pid=75342) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a9:61:19"/><model type="virtio"/><mtu size="1442"/><target dev="tape1665c78-86"/></interface> {{(pid=75342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Attempting to detach device tape1665c78-86 from instance 65e77fb1-8148-46a5-bc53-139b7ea096ad from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] detach device xml: <interface type="ethernet">
Nov 16 18:02:50 user nova-compute[75342]:   <mac address="fa:16:3e:a9:61:19"/>
Nov 16 18:02:50 user nova-compute[75342]:   <model type="virtio"/>
Nov 16 18:02:50 user nova-compute[75342]:   <mtu size="1442"/>
Nov 16 18:02:50 user nova-compute[75342]:   <target dev="tape1665c78-86"/>
Nov 16 18:02:50 user nova-compute[75342]: </interface>
Nov 16 18:02:50 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a9:61:19"/><model type="virtio"/><mtu size="1442"/><target dev="tape1665c78-86"/></interface> {{(pid=75342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a9:61:19"/><model type="virtio"/><mtu size="1442"/><target dev="tape1665c78-86"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 16 18:02:50 user nova-compute[75342]:   <name>instance-00000009</name>
Nov 16 18:02:50 user nova-compute[75342]:   <uuid>65e77fb1-8148-46a5-bc53-139b7ea096ad</uuid>
Nov 16 18:02:50 user nova-compute[75342]:   <metadata>
Nov 16 18:02:50 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:02:50 user nova-compute[75342]:   <nova:package version="0.0.0"/>
Nov 16 18:02:50 user nova-compute[75342]:   <nova:name>tempest-device-tagging-server-1632151976</nova:name>
Nov 16 18:02:50 user nova-compute[75342]:   <nova:creationTime>2023-11-16 18:02:11</nova:creationTime>
Nov 16 18:02:50 user nova-compute[75342]:   <nova:flavor name="m1.tiny">
Nov 16 18:02:50 user nova-compute[75342]:     <nova:memory>512</nova:memory>
Nov 16 18:02:50 user nova-compute[75342]:     <nova:disk>1</nova:disk>
Nov 16 18:02:50 user nova-compute[75342]:     <nova:swap>0</nova:swap>
Nov 16 18:02:50 user nova-compute[75342]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:02:50 user nova-compute[75342]:     <nova:vcpus>1</nova:vcpus>
Nov 16 18:02:50 user nova-compute[75342]:   </nova:flavor>
Nov 16 18:02:50 user nova-compute[75342]:   <nova:owner>
Nov 16 18:02:50 user nova-compute[75342]:     <nova:user uuid="ff61915f003d41a4828ba719c2cfd0a2">tempest-TaggedAttachmentsTest-1574754300-project-member</nova:user>
Nov 16 18:02:50 user nova-compute[75342]:     <nova:project uuid="a4063aba08ce4f1d9c22413cc4ac2775">tempest-TaggedAttachmentsTest-1574754300</nova:project>
Nov 16 18:02:50 user nova-compute[75342]:   </nova:owner>
Nov 16 18:02:50 user nova-compute[75342]:   <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:02:50 user nova-compute[75342]:   <nova:ports>
Nov 16 18:02:50 user nova-compute[75342]:     <nova:port uuid="f1d3a970-40d8-420b-b632-c0231545cd41">
Nov 16 18:02:50 user nova-compute[75342]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 18:02:50 user nova-compute[75342]:     </nova:port>
Nov 16 18:02:50 user nova-compute[75342]:     <nova:port uuid="e1665c78-8646-4a63-ac74-63d44bb0295a">
Nov 16 18:02:50 user nova-compute[75342]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 16 18:02:50 user nova-compute[75342]:     </nova:port>
Nov 16 18:02:50 user nova-compute[75342]:   </nova:ports>
Nov 16 18:02:50 user nova-compute[75342]: </nova:instance>
Nov 16 18:02:50 user nova-compute[75342]:   </metadata>
Nov 16 18:02:50 user nova-compute[75342]:   <memory unit='KiB'>524288</memory>
Nov 16 18:02:50 user nova-compute[75342]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 18:02:50 user nova-compute[75342]:   <vcpu placement='static'>1</vcpu>
Nov 16 18:02:50 user nova-compute[75342]:   <resource>
Nov 16 18:02:50 user nova-compute[75342]:     <partition>/machine</partition>
Nov 16 18:02:50 user nova-compute[75342]:   </resource>
Nov 16 18:02:50 user nova-compute[75342]:   <sysinfo type='smbios'>
Nov 16 18:02:50 user nova-compute[75342]:     <system>
Nov 16 18:02:50 user nova-compute[75342]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 18:02:50 user nova-compute[75342]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 18:02:50 user nova-compute[75342]:       <entry name='version'>0.0.0</entry>
Nov 16 18:02:50 user nova-compute[75342]:       <entry name='serial'>65e77fb1-8148-46a5-bc53-139b7ea096ad</entry>
Nov 16 18:02:50 user nova-compute[75342]:       <entry name='uuid'>65e77fb1-8148-46a5-bc53-139b7ea096ad</entry>
Nov 16 18:02:50 user nova-compute[75342]:       <entry name='family'>Virtual Machine</entry>
Nov 16 18:02:50 user nova-compute[75342]:     </system>
Nov 16 18:02:50 user nova-compute[75342]:   </sysinfo>
Nov 16 18:02:50 user nova-compute[75342]:   <os>
Nov 16 18:02:50 user nova-compute[75342]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 18:02:50 user nova-compute[75342]:     <boot dev='hd'/>
Nov 16 18:02:50 user nova-compute[75342]:     <smbios mode='sysinfo'/>
Nov 16 18:02:50 user nova-compute[75342]:   </os>
Nov 16 18:02:50 user nova-compute[75342]:   <features>
Nov 16 18:02:50 user nova-compute[75342]:     <acpi/>
Nov 16 18:02:50 user nova-compute[75342]:     <apic/>
Nov 16 18:02:50 user nova-compute[75342]:     <vmcoreinfo state='on'/>
Nov 16 18:02:50 user nova-compute[75342]:   </features>
Nov 16 18:02:50 user nova-compute[75342]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 18:02:50 user nova-compute[75342]:     <model fallback='forbid'>Nehalem</model>
Nov 16 18:02:50 user nova-compute[75342]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 18:02:50 user nova-compute[75342]:     <feature policy='require' name='vme'/>
Nov 16 18:02:50 user nova-compute[75342]:     <feature policy='require' name='x2apic'/>
Nov 16 18:02:50 user nova-compute[75342]:     <feature policy='require' name='hypervisor'/>
Nov 16 18:02:50 user nova-compute[75342]:   </cpu>
Nov 16 18:02:50 user nova-compute[75342]:   <clock offset='utc'>
Nov 16 18:02:50 user nova-compute[75342]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 18:02:50 user nova-compute[75342]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 18:02:50 user nova-compute[75342]:     <timer name='hpet' present='no'/>
Nov 16 18:02:50 user nova-compute[75342]:   </clock>
Nov 16 18:02:50 user nova-compute[75342]:   <on_poweroff>destroy</on_poweroff>
Nov 16 18:02:50 user nova-compute[75342]:   <on_reboot>restart</on_reboot>
Nov 16 18:02:50 user nova-compute[75342]:   <on_crash>destroy</on_crash>
Nov 16 18:02:50 user nova-compute[75342]:   <devices>
Nov 16 18:02:50 user nova-compute[75342]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 18:02:50 user nova-compute[75342]:     <disk type='file' device='disk'>
Nov 16 18:02:50 user nova-compute[75342]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 18:02:50 user nova-compute[75342]:       <source file='/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk' index='2'/>
Nov 16 18:02:50 user nova-compute[75342]:       <backingStore type='file' index='3'>
Nov 16 18:02:50 user nova-compute[75342]:         <format type='raw'/>
Nov 16 18:02:50 user nova-compute[75342]:         <source file='/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d'/>
Nov 16 18:02:50 user nova-compute[75342]:         <backingStore/>
Nov 16 18:02:50 user nova-compute[75342]:       </backingStore>
Nov 16 18:02:50 user nova-compute[75342]:       <target dev='vda' bus='virtio'/>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='virtio-disk0'/>
Nov 16 18:02:50 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </disk>
Nov 16 18:02:50 user nova-compute[75342]:     <disk type='file' device='cdrom'>
Nov 16 18:02:50 user nova-compute[75342]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 18:02:50 user nova-compute[75342]:       <source file='/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk.config' index='1'/>
Nov 16 18:02:50 user nova-compute[75342]:       <backingStore/>
Nov 16 18:02:50 user nova-compute[75342]:       <target dev='hda' bus='ide'/>
Nov 16 18:02:50 user nova-compute[75342]:       <readonly/>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='ide0-0-0'/>
Nov 16 18:02:50 user nova-compute[75342]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </disk>
Nov 16 18:02:50 user nova-compute[75342]:     <controller type='usb' index='0' model='none'>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='usb'/>
Nov 16 18:02:50 user nova-compute[75342]:     </controller>
Nov 16 18:02:50 user nova-compute[75342]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='pci.0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </controller>
Nov 16 18:02:50 user nova-compute[75342]:     <controller type='ide' index='0'>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='ide'/>
Nov 16 18:02:50 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 18:02:50 user nova-compute[75342]:     </controller>
Nov 16 18:02:50 user nova-compute[75342]:     <interface type='ethernet'>
Nov 16 18:02:50 user nova-compute[75342]:       <mac address='fa:16:3e:c1:51:1f'/>
Nov 16 18:02:50 user nova-compute[75342]:       <target dev='tapf1d3a970-40'/>
Nov 16 18:02:50 user nova-compute[75342]:       <model type='virtio'/>
Nov 16 18:02:50 user nova-compute[75342]:       <mtu size='1442'/>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='net0'/>
Nov 16 18:02:50 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </interface>
Nov 16 18:02:50 user nova-compute[75342]:     <interface type='ethernet'>
Nov 16 18:02:50 user nova-compute[75342]:       <mac address='fa:16:3e:a9:61:19'/>
Nov 16 18:02:50 user nova-compute[75342]:       <target dev='tape1665c78-86'/>
Nov 16 18:02:50 user nova-compute[75342]:       <model type='virtio'/>
Nov 16 18:02:50 user nova-compute[75342]:       <mtu size='1442'/>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='net1'/>
Nov 16 18:02:50 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </interface>
Nov 16 18:02:50 user nova-compute[75342]:     <serial type='pty'>
Nov 16 18:02:50 user nova-compute[75342]:       <source path='/dev/pts/7'/>
Nov 16 18:02:50 user nova-compute[75342]:       <log file='/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/console.log' append='off'/>
Nov 16 18:02:50 user nova-compute[75342]:       <target type='isa-serial' port='0'>
Nov 16 18:02:50 user nova-compute[75342]:         <model name='isa-serial'/>
Nov 16 18:02:50 user nova-compute[75342]:       </target>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='serial0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </serial>
Nov 16 18:02:50 user nova-compute[75342]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 18:02:50 user nova-compute[75342]:       <source path='/dev/pts/7'/>
Nov 16 18:02:50 user nova-compute[75342]:       <log file='/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/console.log' append='off'/>
Nov 16 18:02:50 user nova-compute[75342]:       <target type='serial' port='0'/>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='serial0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </console>
Nov 16 18:02:50 user nova-compute[75342]:     <input type='mouse' bus='ps2'>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='input0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </input>
Nov 16 18:02:50 user nova-compute[75342]:     <input type='keyboard' bus='ps2'>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='input1'/>
Nov 16 18:02:50 user nova-compute[75342]:     </input>
Nov 16 18:02:50 user nova-compute[75342]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 16 18:02:50 user nova-compute[75342]:       <listen type='address' address='0.0.0.0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </graphics>
Nov 16 18:02:50 user nova-compute[75342]:     <audio id='1' type='none'/>
Nov 16 18:02:50 user nova-compute[75342]:     <video>
Nov 16 18:02:50 user nova-compute[75342]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='video0'/>
Nov 16 18:02:50 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </video>
Nov 16 18:02:50 user nova-compute[75342]:     <memballoon model='virtio'>
Nov 16 18:02:50 user nova-compute[75342]:       <stats period='10'/>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='balloon0'/>
Nov 16 18:02:50 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </memballoon>
Nov 16 18:02:50 user nova-compute[75342]:     <rng model='virtio'>
Nov 16 18:02:50 user nova-compute[75342]:       <backend model='random'>/dev/urandom</backend>
Nov 16 18:02:50 user nova-compute[75342]:       <alias name='rng0'/>
Nov 16 18:02:50 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 18:02:50 user nova-compute[75342]:     </rng>
Nov 16 18:02:50 user nova-compute[75342]:   </devices>
Nov 16 18:02:50 user nova-compute[75342]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 18:02:50 user nova-compute[75342]:     <label>libvirt-65e77fb1-8148-46a5-bc53-139b7ea096ad</label>
Nov 16 18:02:50 user nova-compute[75342]:     <imagelabel>libvirt-65e77fb1-8148-46a5-bc53-139b7ea096ad</imagelabel>
Nov 16 18:02:50 user nova-compute[75342]:   </seclabel>
Nov 16 18:02:50 user nova-compute[75342]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 18:02:50 user nova-compute[75342]:     <label>+64055:+108</label>
Nov 16 18:02:50 user nova-compute[75342]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 18:02:50 user nova-compute[75342]:   </seclabel>
Nov 16 18:02:50 user nova-compute[75342]: </domain>
Nov 16 18:02:50 user nova-compute[75342]:  {{(pid=75342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 18:02:50 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Successfully detached device tape1665c78-86 from instance 65e77fb1-8148-46a5-bc53-139b7ea096ad from the persistent domain config.
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] (1/8): Attempting to detach device tape1665c78-86 with device alias net1 from instance 65e77fb1-8148-46a5-bc53-139b7ea096ad from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] detach device xml: <interface type="ethernet">
Nov 16 18:02:50 user nova-compute[75342]:   <mac address="fa:16:3e:a9:61:19"/>
Nov 16 18:02:50 user nova-compute[75342]:   <model type="virtio"/>
Nov 16 18:02:50 user nova-compute[75342]:   <mtu size="1442"/>
Nov 16 18:02:50 user nova-compute[75342]:   <target dev="tape1665c78-86"/>
Nov 16 18:02:50 user nova-compute[75342]: </interface>
Nov 16 18:02:50 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:02:50 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.696s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Start waiting for the detach event from libvirt for device tape1665c78-86 with device alias net1 for instance 65e77fb1-8148-46a5-bc53-139b7ea096ad {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:02:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:02:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG nova.policy [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f21531e56db949a0a0a30925635a35d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1f044ccaee41cfa073d66a26578f3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:02:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Creating image(s)
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "/opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "/opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-c6fc17a6-c475-4d01-94d8-5ef7f328bad0 req-d0832b5b-f312-4887-986b-094753809ee5 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-vif-unplugged-e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c6fc17a6-c475-4d01-94d8-5ef7f328bad0 req-d0832b5b-f312-4887-986b-094753809ee5 service nova] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c6fc17a6-c475-4d01-94d8-5ef7f328bad0 req-d0832b5b-f312-4887-986b-094753809ee5 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c6fc17a6-c475-4d01-94d8-5ef7f328bad0 req-d0832b5b-f312-4887-986b-094753809ee5 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-c6fc17a6-c475-4d01-94d8-5ef7f328bad0 req-d0832b5b-f312-4887-986b-094753809ee5 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] No waiting events found dispatching network-vif-unplugged-e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:51 user nova-compute[75342]: WARNING nova.compute.manager [req-c6fc17a6-c475-4d01-94d8-5ef7f328bad0 req-d0832b5b-f312-4887-986b-094753809ee5 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received unexpected event network-vif-unplugged-e1665c78-8646-4a63-ac74-63d44bb0295a for instance with vm_state active and task_state None.
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.237s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] swap_volume: Updating volume 02fa77ca-71f8-462f-977c-a9868c80fd9c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "EMaZWImv", "auth_password": "fOmTbj4tIGBcH3", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "a05c843f-c695-449f-baf7-d4b8559db14c"}, "status": "reserved", "instance": "07c92356-fdd3-4884-b406-55c92c63db18", "attached_at": "", "detached_at": "", "volume_id": "a05c843f-c695-449f-baf7-d4b8559db14c", "serial": "a05c843f-c695-449f-baf7-d4b8559db14c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a05c843f-c695-449f-baf7-d4b8559db14c', 'no_device': None, 'attachment_id': '7aadc2be-9c28-4e26-8070-cce0718b53ff'} {{(pid=75342) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e919b671-523f-4910-87fd-27f9082064a2 tempest-TestVolumeSwap-378969112 tempest-TestVolumeSwap-378969112-project-admin] Lock "07c92356-fdd3-4884-b406-55c92c63db18" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.223s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG os_brick.utils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63f4634-46ea-49a5-9866-6ec3b650edaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[255a5bd8-0fe1-4a64-8464-1046decf95d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58d6e94-1994-4496-885d-86948dfc2e4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk 1073741824" returned: 0 in 0.070s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f318a26a-455a-40dd-b09e-a691a4180892]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Successfully created port: 201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:02:52 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ea3774-25b3-4e30-b1ab-caf1cf4217cf]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG os_brick.utils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] <== get_connector_properties: return (279ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Updating existing volume attachment record: eeef062f-e6bb-49cb-a36c-4784bd800946 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.204s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Cannot resize image /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Ensure instance console log exists: /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Successfully updated port: 201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "refresh_cache-2b4221b3-7f0d-4299-8bf2-865a46133a9e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquired lock "refresh_cache-2b4221b3-7f0d-4299-8bf2-865a46133a9e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-f4dbebdc-54db-4e70-a22d-0674b1554603 req-951c76ae-018d-418f-8f9b-a803a3ec582b service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Received event network-changed-201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-f4dbebdc-54db-4e70-a22d-0674b1554603 req-951c76ae-018d-418f-8f9b-a803a3ec582b service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Refreshing instance network info cache due to event network-changed-201edf7f-0ff2-4878-aa2f-431868b79042. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f4dbebdc-54db-4e70-a22d-0674b1554603 req-951c76ae-018d-418f-8f9b-a803a3ec582b service nova] Acquiring lock "refresh_cache-2b4221b3-7f0d-4299-8bf2-865a46133a9e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:02:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Updating instance_info_cache with network_info: [{"id": "201edf7f-0ff2-4878-aa2f-431868b79042", "address": "fa:16:3e:94:16:c4", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201edf7f-0f", "ovs_interfaceid": "201edf7f-0ff2-4878-aa2f-431868b79042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Releasing lock "refresh_cache-2b4221b3-7f0d-4299-8bf2-865a46133a9e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Instance network_info: |[{"id": "201edf7f-0ff2-4878-aa2f-431868b79042", "address": "fa:16:3e:94:16:c4", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201edf7f-0f", "ovs_interfaceid": "201edf7f-0ff2-4878-aa2f-431868b79042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f4dbebdc-54db-4e70-a22d-0674b1554603 req-951c76ae-018d-418f-8f9b-a803a3ec582b service nova] Acquired lock "refresh_cache-2b4221b3-7f0d-4299-8bf2-865a46133a9e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.network.neutron [req-f4dbebdc-54db-4e70-a22d-0674b1554603 req-951c76ae-018d-418f-8f9b-a803a3ec582b service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Refreshing network info cache for port 201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Start _get_guest_xml network_info=[{"id": "201edf7f-0ff2-4878-aa2f-431868b79042", "address": "fa:16:3e:94:16:c4", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201edf7f-0f", "ovs_interfaceid": "201edf7f-0ff2-4878-aa2f-431868b79042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:02:53 user nova-compute[75342]: INFO nova.compute.manager [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Detaching volume a05c843f-c695-449f-baf7-d4b8559db14c
Nov 16 18:02:53 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:02:53 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1746490084',display_name='tempest-VolumesAdminNegativeTest-server-1746490084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1746490084',id=14,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d1f044ccaee41cfa073d66a26578f3d',ramdisk_id='',reservation_id='r-7egy1lkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2111670408',owner_user_name='tempest-VolumesAdminNegativeTest-2111670408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:02:51Z,user_data=None,user_id='f21531e56db949a0a0a30925635a35d4',uuid=2b4221b3-7f0d-4299-8bf2-865a46133a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201edf7f-0ff2-4878-aa2f-431868b79042", "address": "fa:16:3e:94:16:c4", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201edf7f-0f", "ovs_interfaceid": "201edf7f-0ff2-4878-aa2f-431868b79042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converting VIF {"id": "201edf7f-0ff2-4878-aa2f-431868b79042", "address": "fa:16:3e:94:16:c4", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201edf7f-0f", "ovs_interfaceid": "201edf7f-0ff2-4878-aa2f-431868b79042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=201edf7f-0ff2-4878-aa2f-431868b79042,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201edf7f-0f') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.objects.instance [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b4221b3-7f0d-4299-8bf2-865a46133a9e {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:53 user nova-compute[75342]: INFO nova.virt.block_device [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Attempting to driver detach volume a05c843f-c695-449f-baf7-d4b8559db14c from mountpoint /dev/vdb
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:02:53 user nova-compute[75342]:   <uuid>2b4221b3-7f0d-4299-8bf2-865a46133a9e</uuid>
Nov 16 18:02:53 user nova-compute[75342]:   <name>instance-0000000e</name>
Nov 16 18:02:53 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:02:53 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:02:53 user nova-compute[75342]:   <metadata>
Nov 16 18:02:53 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:02:53 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:02:53 user nova-compute[75342]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1746490084</nova:name>
Nov 16 18:02:53 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:02:53</nova:creationTime>
Nov 16 18:02:53 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:02:53 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:02:53 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:02:53 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:02:53 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:02:53 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:02:53 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:02:53 user nova-compute[75342]:       <nova:owner>
Nov 16 18:02:53 user nova-compute[75342]:         <nova:user uuid="f21531e56db949a0a0a30925635a35d4">tempest-VolumesAdminNegativeTest-2111670408-project-member</nova:user>
Nov 16 18:02:53 user nova-compute[75342]:         <nova:project uuid="6d1f044ccaee41cfa073d66a26578f3d">tempest-VolumesAdminNegativeTest-2111670408</nova:project>
Nov 16 18:02:53 user nova-compute[75342]:       </nova:owner>
Nov 16 18:02:53 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:02:53 user nova-compute[75342]:       <nova:ports>
Nov 16 18:02:53 user nova-compute[75342]:         <nova:port uuid="201edf7f-0ff2-4878-aa2f-431868b79042">
Nov 16 18:02:53 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 18:02:53 user nova-compute[75342]:         </nova:port>
Nov 16 18:02:53 user nova-compute[75342]:       </nova:ports>
Nov 16 18:02:53 user nova-compute[75342]:     </nova:instance>
Nov 16 18:02:53 user nova-compute[75342]:   </metadata>
Nov 16 18:02:53 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:02:53 user nova-compute[75342]:     <system>
Nov 16 18:02:53 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:02:53 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:02:53 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:02:53 user nova-compute[75342]:       <entry name="serial">2b4221b3-7f0d-4299-8bf2-865a46133a9e</entry>
Nov 16 18:02:53 user nova-compute[75342]:       <entry name="uuid">2b4221b3-7f0d-4299-8bf2-865a46133a9e</entry>
Nov 16 18:02:53 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:02:53 user nova-compute[75342]:     </system>
Nov 16 18:02:53 user nova-compute[75342]:   </sysinfo>
Nov 16 18:02:53 user nova-compute[75342]:   <os>
Nov 16 18:02:53 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:02:53 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:02:53 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:02:53 user nova-compute[75342]:   </os>
Nov 16 18:02:53 user nova-compute[75342]:   <features>
Nov 16 18:02:53 user nova-compute[75342]:     <acpi/>
Nov 16 18:02:53 user nova-compute[75342]:     <apic/>
Nov 16 18:02:53 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:02:53 user nova-compute[75342]:   </features>
Nov 16 18:02:53 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:02:53 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:02:53 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:02:53 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:02:53 user nova-compute[75342]:   </clock>
Nov 16 18:02:53 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:02:53 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:02:53 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:02:53 user nova-compute[75342]:   </cpu>
Nov 16 18:02:53 user nova-compute[75342]:   <devices>
Nov 16 18:02:53 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:02:53 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:02:53 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk"/>
Nov 16 18:02:53 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:02:53 user nova-compute[75342]:     </disk>
Nov 16 18:02:53 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:02:53 user nova-compute[75342]:       <mac address="fa:16:3e:94:16:c4"/>
Nov 16 18:02:53 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:02:53 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:02:53 user nova-compute[75342]:       <target dev="tap201edf7f-0f"/>
Nov 16 18:02:53 user nova-compute[75342]:     </interface>
Nov 16 18:02:53 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:02:53 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/console.log" append="off"/>
Nov 16 18:02:53 user nova-compute[75342]:     </serial>
Nov 16 18:02:53 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:02:53 user nova-compute[75342]:     <video>
Nov 16 18:02:53 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:02:53 user nova-compute[75342]:     </video>
Nov 16 18:02:53 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:02:53 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:02:53 user nova-compute[75342]:     </rng>
Nov 16 18:02:53 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:02:53 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:02:53 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:02:53 user nova-compute[75342]:     </memballoon>
Nov 16 18:02:53 user nova-compute[75342]:   </devices>
Nov 16 18:02:53 user nova-compute[75342]: </domain>
Nov 16 18:02:53 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1746490084',display_name='tempest-VolumesAdminNegativeTest-server-1746490084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1746490084',id=14,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d1f044ccaee41cfa073d66a26578f3d',ramdisk_id='',reservation_id='r-7egy1lkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2111670408',owner_user_name='tempest-VolumesAdminNegativeTest-2111670408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:02:51Z,user_data=None,user_id='f21531e56db949a0a0a30925635a35d4',uuid=2b4221b3-7f0d-4299-8bf2-865a46133a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201edf7f-0ff2-4878-aa2f-431868b79042", "address": "fa:16:3e:94:16:c4", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201edf7f-0f", "ovs_interfaceid": "201edf7f-0ff2-4878-aa2f-431868b79042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converting VIF {"id": "201edf7f-0ff2-4878-aa2f-431868b79042", "address": "fa:16:3e:94:16:c4", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201edf7f-0f", "ovs_interfaceid": "201edf7f-0ff2-4878-aa2f-431868b79042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=201edf7f-0ff2-4878-aa2f-431868b79042,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201edf7f-0f') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG os_vif [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=201edf7f-0ff2-4878-aa2f-431868b79042,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201edf7f-0f') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '218391a5-e588-57c0-87d3-ffa258728540', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Attempting to detach device vdb from instance 07c92356-fdd3-4884-b406-55c92c63db18 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:02:53 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:53 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:02:53 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:02:53 user nova-compute[75342]:   <serial>a05c843f-c695-449f-baf7-d4b8559db14c</serial>
Nov 16 18:02:53 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:02:53 user nova-compute[75342]: </disk>
Nov 16 18:02:53 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap201edf7f-0f, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap201edf7f-0f, col_values=(('qos', UUID('4dc99ee4-dc25-42c3-9120-7296045f4e02')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap201edf7f-0f, col_values=(('external_ids', {'iface-id': '201edf7f-0ff2-4878-aa2f-431868b79042', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:16:c4', 'vm-uuid': '2b4221b3-7f0d-4299-8bf2-865a46133a9e'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:53 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Successfully detached device vdb from instance 07c92356-fdd3-4884-b406-55c92c63db18 from the persistent domain config.
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07c92356-fdd3-4884-b406-55c92c63db18 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:02:53 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:53 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:02:53 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:02:53 user nova-compute[75342]:   <serial>a05c843f-c695-449f-baf7-d4b8559db14c</serial>
Nov 16 18:02:53 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:02:53 user nova-compute[75342]: </disk>
Nov 16 18:02:53 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:53 user nova-compute[75342]: INFO os_vif [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=201edf7f-0ff2-4878-aa2f-431868b79042,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201edf7f-0f')
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] No VIF found with MAC fa:16:3e:94:16:c4, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-0f5b6ef0-921a-48d8-bad5-b25014c340be req-1d99f360-3a1b-462c-b1d0-40665bd050a9 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-vif-plugged-e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0f5b6ef0-921a-48d8-bad5-b25014c340be req-1d99f360-3a1b-462c-b1d0-40665bd050a9 service nova] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0f5b6ef0-921a-48d8-bad5-b25014c340be req-1d99f360-3a1b-462c-b1d0-40665bd050a9 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0f5b6ef0-921a-48d8-bad5-b25014c340be req-1d99f360-3a1b-462c-b1d0-40665bd050a9 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-0f5b6ef0-921a-48d8-bad5-b25014c340be req-1d99f360-3a1b-462c-b1d0-40665bd050a9 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] No waiting events found dispatching network-vif-plugged-e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:53 user nova-compute[75342]: WARNING nova.compute.manager [req-0f5b6ef0-921a-48d8-bad5-b25014c340be req-1d99f360-3a1b-462c-b1d0-40665bd050a9 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received unexpected event network-vif-plugged-e1665c78-8646-4a63-ac74-63d44bb0295a for instance with vm_state active and task_state None.
Nov 16 18:02:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07c92356-fdd3-4884-b406-55c92c63db18 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:02:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-f4dbebdc-54db-4e70-a22d-0674b1554603 req-951c76ae-018d-418f-8f9b-a803a3ec582b service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Updated VIF entry in instance network info cache for port 201edf7f-0ff2-4878-aa2f-431868b79042. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:02:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-f4dbebdc-54db-4e70-a22d-0674b1554603 req-951c76ae-018d-418f-8f9b-a803a3ec582b service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Updating instance_info_cache with network_info: [{"id": "201edf7f-0ff2-4878-aa2f-431868b79042", "address": "fa:16:3e:94:16:c4", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201edf7f-0f", "ovs_interfaceid": "201edf7f-0ff2-4878-aa2f-431868b79042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:02:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f4dbebdc-54db-4e70-a22d-0674b1554603 req-951c76ae-018d-418f-8f9b-a803a3ec582b service nova] Releasing lock "refresh_cache-2b4221b3-7f0d-4299-8bf2-865a46133a9e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:02:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-4dd3bc08-04d6-4f21-ad47-d71768dd466f req-6c14e416-7193-41a1-8864-678047de827f service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Received event network-vif-plugged-201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4dd3bc08-04d6-4f21-ad47-d71768dd466f req-6c14e416-7193-41a1-8864-678047de827f service nova] Acquiring lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4dd3bc08-04d6-4f21-ad47-d71768dd466f req-6c14e416-7193-41a1-8864-678047de827f service nova] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4dd3bc08-04d6-4f21-ad47-d71768dd466f req-6c14e416-7193-41a1-8864-678047de827f service nova] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-4dd3bc08-04d6-4f21-ad47-d71768dd466f req-6c14e416-7193-41a1-8864-678047de827f service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] No waiting events found dispatching network-vif-plugged-201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:56 user nova-compute[75342]: WARNING nova.compute.manager [req-4dd3bc08-04d6-4f21-ad47-d71768dd466f req-6c14e416-7193-41a1-8864-678047de827f service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Received unexpected event network-vif-plugged-201edf7f-0ff2-4878-aa2f-431868b79042 for instance with vm_state building and task_state spawning.
Nov 16 18:02:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:02:57 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Instance spawned successfully.
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:02:57 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Creating image(s)
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Ensure instance console log exists: /opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Start _get_guest_xml network_info=[{"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'eeef062f-e6bb-49cb-a36c-4784bd800946', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbNZPLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78afab8c-3e7c-4697-86b8-726c6ed252c5', 'attached_at': '', 'detached_at': '', 'volume_id': 'c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5', 'serial': 'c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:02:57 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:02:57 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbNZPLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:02:57 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:57 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:02:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:02:57 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:02:57 user nova-compute[75342]: INFO nova.compute.manager [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 16 18:02:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[526ea343-88e7-4979-ba93-721d5a1bf84a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:02:57 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[435ca4d4-973d-481c-8eca-f5c74c93397e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5] added
Nov 16 18:02:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba81c2fc-e35b-4ed3-b74e-34f39c0eb5d5]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f59339c-263a-455f-aaf0-68af7297dba5]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbNZPLjf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:57 user nova-compute[75342]: INFO nova.compute.manager [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Took 7.61 seconds to build instance.
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbNZPLjf" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[03436b64-085b-488a-acf7-826126adfedc]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FbNZPLjf'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ca1293-ebfd-4b7f-ba90-e0967558ca0f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b1f90d-acf5-4e70-b9f5-a41416b61154]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:58 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:58 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef0f3549-ca08-455f-a5a6-746f6fab3644 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.814s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-f7764120-d958-430e-bff4-3953d7667b4f req-93040304-62a0-4f25-80e4-f8161b4e0cb2 service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Received event network-vif-plugged-201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f7764120-d958-430e-bff4-3953d7667b4f req-93040304-62a0-4f25-80e4-f8161b4e0cb2 service nova] Acquiring lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f7764120-d958-430e-bff4-3953d7667b4f req-93040304-62a0-4f25-80e4-f8161b4e0cb2 service nova] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f7764120-d958-430e-bff4-3953d7667b4f req-93040304-62a0-4f25-80e4-f8161b4e0cb2 service nova] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-f7764120-d958-430e-bff4-3953d7667b4f req-93040304-62a0-4f25-80e4-f8161b4e0cb2 service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] No waiting events found dispatching network-vif-plugged-201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:02:58 user nova-compute[75342]: WARNING nova.compute.manager [req-f7764120-d958-430e-bff4-3953d7667b4f req-93040304-62a0-4f25-80e4-f8161b4e0cb2 service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Received unexpected event network-vif-plugged-201edf7f-0ff2-4878-aa2f-431868b79042 for instance with vm_state active and task_state None.
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[610da367-c4e4-4510-9321-13c0ded49af8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5, portal: 172.16.0.220,3260]
Nov 16 18:02:58 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5, portal: 172.16.0.220,3260] successful.
Nov 16 18:02:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3914dd0-c056-405b-a893-9cedba6c7310]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd54467-5112-45a0-be74-b81e9384996a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:58 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:58 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:02:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:02:58 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:02:58 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:02:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[920dce1c-843f-46fd-b78a-9aafe7ecd47c]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbNZPLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:58 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:02:58 user nova-compute[75342]: INFO nova.compute.claims [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Claim successful on node user
Nov 16 18:02:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23466386161326536', 'path': '/dev/sdd'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466386161326536', 'path': '/dev/sdd'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670881738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670881738',id=13,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-f1kum1ys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:02:46Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=78afab8c-3e7c-4697-86b8-726c6ed252c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=3412866c-1a34-4be9-91b5-37959486c6cc,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3412866c-1a') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.objects.instance [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'pci_devices' on Instance uuid 78afab8c-3e7c-4697-86b8-726c6ed252c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:02:59 user nova-compute[75342]:   <uuid>78afab8c-3e7c-4697-86b8-726c6ed252c5</uuid>
Nov 16 18:02:59 user nova-compute[75342]:   <name>instance-0000000d</name>
Nov 16 18:02:59 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:02:59 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:02:59 user nova-compute[75342]:   <metadata>
Nov 16 18:02:59 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:02:59 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:02:59 user nova-compute[75342]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1670881738</nova:name>
Nov 16 18:02:59 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:02:57</nova:creationTime>
Nov 16 18:02:59 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:02:59 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:02:59 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:02:59 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:02:59 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:02:59 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:02:59 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:02:59 user nova-compute[75342]:       <nova:owner>
Nov 16 18:02:59 user nova-compute[75342]:         <nova:user uuid="13beba5fa97a448fa863135a45e47cb9">tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member</nova:user>
Nov 16 18:02:59 user nova-compute[75342]:         <nova:project uuid="4542bb854a1647618ba3995c4342109a">tempest-ServerBootFromVolumeStableRescueTest-764398626</nova:project>
Nov 16 18:02:59 user nova-compute[75342]:       </nova:owner>
Nov 16 18:02:59 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:02:59 user nova-compute[75342]:       <nova:ports>
Nov 16 18:02:59 user nova-compute[75342]:         <nova:port uuid="3412866c-1a34-4be9-91b5-37959486c6cc">
Nov 16 18:02:59 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 18:02:59 user nova-compute[75342]:         </nova:port>
Nov 16 18:02:59 user nova-compute[75342]:       </nova:ports>
Nov 16 18:02:59 user nova-compute[75342]:     </nova:instance>
Nov 16 18:02:59 user nova-compute[75342]:   </metadata>
Nov 16 18:02:59 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:02:59 user nova-compute[75342]:     <system>
Nov 16 18:02:59 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:02:59 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:02:59 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:02:59 user nova-compute[75342]:       <entry name="serial">78afab8c-3e7c-4697-86b8-726c6ed252c5</entry>
Nov 16 18:02:59 user nova-compute[75342]:       <entry name="uuid">78afab8c-3e7c-4697-86b8-726c6ed252c5</entry>
Nov 16 18:02:59 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:02:59 user nova-compute[75342]:     </system>
Nov 16 18:02:59 user nova-compute[75342]:   </sysinfo>
Nov 16 18:02:59 user nova-compute[75342]:   <os>
Nov 16 18:02:59 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:02:59 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:02:59 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:02:59 user nova-compute[75342]:   </os>
Nov 16 18:02:59 user nova-compute[75342]:   <features>
Nov 16 18:02:59 user nova-compute[75342]:     <acpi/>
Nov 16 18:02:59 user nova-compute[75342]:     <apic/>
Nov 16 18:02:59 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:02:59 user nova-compute[75342]:   </features>
Nov 16 18:02:59 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:02:59 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:02:59 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:02:59 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:02:59 user nova-compute[75342]:   </clock>
Nov 16 18:02:59 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:02:59 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:02:59 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:02:59 user nova-compute[75342]:   </cpu>
Nov 16 18:02:59 user nova-compute[75342]:   <devices>
Nov 16 18:02:59 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:02:59 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:02:59 user nova-compute[75342]:       <source dev="/dev/sdd"/>
Nov 16 18:02:59 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:02:59 user nova-compute[75342]:       <serial>c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5</serial>
Nov 16 18:02:59 user nova-compute[75342]:     </disk>
Nov 16 18:02:59 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:02:59 user nova-compute[75342]:       <mac address="fa:16:3e:32:a2:86"/>
Nov 16 18:02:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:02:59 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:02:59 user nova-compute[75342]:       <target dev="tap3412866c-1a"/>
Nov 16 18:02:59 user nova-compute[75342]:     </interface>
Nov 16 18:02:59 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:02:59 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/console.log" append="off"/>
Nov 16 18:02:59 user nova-compute[75342]:     </serial>
Nov 16 18:02:59 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:02:59 user nova-compute[75342]:     <video>
Nov 16 18:02:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:02:59 user nova-compute[75342]:     </video>
Nov 16 18:02:59 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:02:59 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:02:59 user nova-compute[75342]:     </rng>
Nov 16 18:02:59 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:02:59 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:02:59 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:02:59 user nova-compute[75342]:     </memballoon>
Nov 16 18:02:59 user nova-compute[75342]:   </devices>
Nov 16 18:02:59 user nova-compute[75342]: </domain>
Nov 16 18:02:59 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670881738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670881738',id=13,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-f1kum1ys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:02:46Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=78afab8c-3e7c-4697-86b8-726c6ed252c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=3412866c-1a34-4be9-91b5-37959486c6cc,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3412866c-1a') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG os_vif [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=3412866c-1a34-4be9-91b5-37959486c6cc,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3412866c-1a') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e12870e1-4b84-5845-9465-263f0b146ef4', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3412866c-1a, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3412866c-1a, col_values=(('qos', UUID('ed80ecfa-8ffa-4dcc-b2cd-db8f55630405')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3412866c-1a, col_values=(('external_ids', {'iface-id': '3412866c-1a34-4be9-91b5-37959486c6cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:a2:86', 'vm-uuid': '78afab8c-3e7c-4697-86b8-726c6ed252c5'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:02:59 user nova-compute[75342]: INFO os_vif [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=3412866c-1a34-4be9-91b5-37959486c6cc,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3412866c-1a')
Nov 16 18:02:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.compute.manager [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No VIF found with MAC fa:16:3e:32:a2:86, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.compute.manager [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.042s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:02:59 user nova-compute[75342]: INFO nova.compute.claims [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Claim successful on node user
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.compute.manager [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.network.neutron [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:02:59 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:02:59 user nova-compute[75342]: DEBUG nova.compute.manager [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG nova.policy [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0697a15cd0054cef90459da99a3fd8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d87f343b6e4dbead83e037619ae49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:03:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Creating image(s)
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.199s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.173s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.207s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG nova.network.neutron [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk 1073741824" returned: 0 in 0.075s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG nova.network.neutron [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Successfully created port: 5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.policy [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0697a15cd0054cef90459da99a3fd8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d87f343b6e4dbead83e037619ae49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.222s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:03:01 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Creating image(s)
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Cannot resize image /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Ensure instance console log exists: /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.compute.manager [req-9686e319-3e2a-4c40-a7e1-148f49ccbf48 req-74636019-afea-4ca3-9b08-abc0eb875f24 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9686e319-3e2a-4c40-a7e1-148f49ccbf48 req-74636019-afea-4ca3-9b08-abc0eb875f24 service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9686e319-3e2a-4c40-a7e1-148f49ccbf48 req-74636019-afea-4ca3-9b08-abc0eb875f24 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9686e319-3e2a-4c40-a7e1-148f49ccbf48 req-74636019-afea-4ca3-9b08-abc0eb875f24 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.compute.manager [req-9686e319-3e2a-4c40-a7e1-148f49ccbf48 req-74636019-afea-4ca3-9b08-abc0eb875f24 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:01 user nova-compute[75342]: WARNING nova.compute.manager [req-9686e319-3e2a-4c40-a7e1-148f49ccbf48 req-74636019-afea-4ca3-9b08-abc0eb875f24 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received unexpected event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with vm_state building and task_state spawning.
Nov 16 18:03:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.208s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.network.neutron [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Successfully created port: 804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk 1073741824" returned: 0 in 0.082s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.network.neutron [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Successfully updated port: 5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:03:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquired lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-4bd06836-199d-4cc5-be8c-386fbc5fff00 req-92e9ba03-8a40-4f31-b411-8b6060e223b0 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-changed-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-4bd06836-199d-4cc5-be8c-386fbc5fff00 req-92e9ba03-8a40-4f31-b411-8b6060e223b0 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Refreshing instance network info cache due to event network-changed-5790346b-5f12-43ca-8348-7401eff36734. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4bd06836-199d-4cc5-be8c-386fbc5fff00 req-92e9ba03-8a40-4f31-b411-8b6060e223b0 service nova] Acquiring lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Cannot resize image /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Ensure instance console log exists: /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Successfully updated port: 804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Updating instance_info_cache with network_info: [{"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquired lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Releasing lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Instance network_info: |[{"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4bd06836-199d-4cc5-be8c-386fbc5fff00 req-92e9ba03-8a40-4f31-b411-8b6060e223b0 service nova] Acquired lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.neutron [req-4bd06836-199d-4cc5-be8c-386fbc5fff00 req-92e9ba03-8a40-4f31-b411-8b6060e223b0 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Refreshing network info cache for port 5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Start _get_guest_xml network_info=[{"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-f9116f78-5bc2-48e1-a79d-e06467c915d9 req-0de25ed2-ba0f-4592-90c7-7ca7bb5abb5d service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received event network-changed-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-f9116f78-5bc2-48e1-a79d-e06467c915d9 req-0de25ed2-ba0f-4592-90c7-7ca7bb5abb5d service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Refreshing instance network info cache due to event network-changed-804687ae-e749-44ee-ada3-856923763b9b. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f9116f78-5bc2-48e1-a79d-e06467c915d9 req-0de25ed2-ba0f-4592-90c7-7ca7bb5abb5d service nova] Acquiring lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:02 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:03:02 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1931076852',display_name='tempest-ServerRescueNegativeTestJSON-server-1931076852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1931076852',id=15,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-aaovrqtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:00Z,user_data=None,user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=d0385123-12ff-41a3-a78d-ac5ce325ae0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:53:c1,bridge_name='br-int',has_traffic_filtering=True,id=5790346b-5f12-43ca-8348-7401eff36734,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5790346b-5f') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.objects.instance [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'pci_devices' on Instance uuid d0385123-12ff-41a3-a78d-ac5ce325ae0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:03:02 user nova-compute[75342]:   <uuid>d0385123-12ff-41a3-a78d-ac5ce325ae0d</uuid>
Nov 16 18:03:02 user nova-compute[75342]:   <name>instance-0000000f</name>
Nov 16 18:03:02 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:03:02 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:03:02 user nova-compute[75342]:   <metadata>
Nov 16 18:03:02 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:03:02 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:03:02 user nova-compute[75342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1931076852</nova:name>
Nov 16 18:03:02 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:03:02</nova:creationTime>
Nov 16 18:03:02 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:03:02 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:03:02 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:03:02 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:03:02 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:03:02 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:03:02 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:03:02 user nova-compute[75342]:       <nova:owner>
Nov 16 18:03:02 user nova-compute[75342]:         <nova:user uuid="0697a15cd0054cef90459da99a3fd8ec">tempest-ServerRescueNegativeTestJSON-935902109-project-member</nova:user>
Nov 16 18:03:02 user nova-compute[75342]:         <nova:project uuid="02d87f343b6e4dbead83e037619ae49c">tempest-ServerRescueNegativeTestJSON-935902109</nova:project>
Nov 16 18:03:02 user nova-compute[75342]:       </nova:owner>
Nov 16 18:03:02 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:03:02 user nova-compute[75342]:       <nova:ports>
Nov 16 18:03:02 user nova-compute[75342]:         <nova:port uuid="5790346b-5f12-43ca-8348-7401eff36734">
Nov 16 18:03:02 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 18:03:02 user nova-compute[75342]:         </nova:port>
Nov 16 18:03:02 user nova-compute[75342]:       </nova:ports>
Nov 16 18:03:02 user nova-compute[75342]:     </nova:instance>
Nov 16 18:03:02 user nova-compute[75342]:   </metadata>
Nov 16 18:03:02 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:03:02 user nova-compute[75342]:     <system>
Nov 16 18:03:02 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:03:02 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:03:02 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:03:02 user nova-compute[75342]:       <entry name="serial">d0385123-12ff-41a3-a78d-ac5ce325ae0d</entry>
Nov 16 18:03:02 user nova-compute[75342]:       <entry name="uuid">d0385123-12ff-41a3-a78d-ac5ce325ae0d</entry>
Nov 16 18:03:02 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:03:02 user nova-compute[75342]:     </system>
Nov 16 18:03:02 user nova-compute[75342]:   </sysinfo>
Nov 16 18:03:02 user nova-compute[75342]:   <os>
Nov 16 18:03:02 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:03:02 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:03:02 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:03:02 user nova-compute[75342]:   </os>
Nov 16 18:03:02 user nova-compute[75342]:   <features>
Nov 16 18:03:02 user nova-compute[75342]:     <acpi/>
Nov 16 18:03:02 user nova-compute[75342]:     <apic/>
Nov 16 18:03:02 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:03:02 user nova-compute[75342]:   </features>
Nov 16 18:03:02 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:03:02 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:03:02 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:03:02 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:03:02 user nova-compute[75342]:   </clock>
Nov 16 18:03:02 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:03:02 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:03:02 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:03:02 user nova-compute[75342]:   </cpu>
Nov 16 18:03:02 user nova-compute[75342]:   <devices>
Nov 16 18:03:02 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:03:02 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:03:02 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk"/>
Nov 16 18:03:02 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:03:02 user nova-compute[75342]:     </disk>
Nov 16 18:03:02 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:03:02 user nova-compute[75342]:       <mac address="fa:16:3e:f5:53:c1"/>
Nov 16 18:03:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:03:02 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:03:02 user nova-compute[75342]:       <target dev="tap5790346b-5f"/>
Nov 16 18:03:02 user nova-compute[75342]:     </interface>
Nov 16 18:03:02 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:03:02 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/console.log" append="off"/>
Nov 16 18:03:02 user nova-compute[75342]:     </serial>
Nov 16 18:03:02 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:03:02 user nova-compute[75342]:     <video>
Nov 16 18:03:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:03:02 user nova-compute[75342]:     </video>
Nov 16 18:03:02 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:03:02 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:03:02 user nova-compute[75342]:     </rng>
Nov 16 18:03:02 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:03:02 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:03:02 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:03:02 user nova-compute[75342]:     </memballoon>
Nov 16 18:03:02 user nova-compute[75342]:   </devices>
Nov 16 18:03:02 user nova-compute[75342]: </domain>
Nov 16 18:03:02 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1931076852',display_name='tempest-ServerRescueNegativeTestJSON-server-1931076852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1931076852',id=15,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-aaovrqtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:00Z,user_data=None,user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=d0385123-12ff-41a3-a78d-ac5ce325ae0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:53:c1,bridge_name='br-int',has_traffic_filtering=True,id=5790346b-5f12-43ca-8348-7401eff36734,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5790346b-5f') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG os_vif [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:53:c1,bridge_name='br-int',has_traffic_filtering=True,id=5790346b-5f12-43ca-8348-7401eff36734,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5790346b-5f') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdeaec68-448e-5f19-a8c4-b65fa773c314', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5790346b-5f, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5790346b-5f, col_values=(('qos', UUID('49e8ed01-89ac-4f0e-aa0c-4e426c1a267c')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5790346b-5f, col_values=(('external_ids', {'iface-id': '5790346b-5f12-43ca-8348-7401eff36734', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:53:c1', 'vm-uuid': 'd0385123-12ff-41a3-a78d-ac5ce325ae0d'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:02 user nova-compute[75342]: INFO os_vif [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:53:c1,bridge_name='br-int',has_traffic_filtering=True,id=5790346b-5f12-43ca-8348-7401eff36734,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5790346b-5f')
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No VIF found with MAC fa:16:3e:f5:53:c1, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Updating instance_info_cache with network_info: [{"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Releasing lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Instance network_info: |[{"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f9116f78-5bc2-48e1-a79d-e06467c915d9 req-0de25ed2-ba0f-4592-90c7-7ca7bb5abb5d service nova] Acquired lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.neutron [req-f9116f78-5bc2-48e1-a79d-e06467c915d9 req-0de25ed2-ba0f-4592-90c7-7ca7bb5abb5d service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Refreshing network info cache for port 804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Start _get_guest_xml network_info=[{"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.neutron [req-4bd06836-199d-4cc5-be8c-386fbc5fff00 req-92e9ba03-8a40-4f31-b411-8b6060e223b0 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Updated VIF entry in instance network info cache for port 5790346b-5f12-43ca-8348-7401eff36734. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.neutron [req-4bd06836-199d-4cc5-be8c-386fbc5fff00 req-92e9ba03-8a40-4f31-b411-8b6060e223b0 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Updating instance_info_cache with network_info: [{"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:02 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:03:02 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4bd06836-199d-4cc5-be8c-386fbc5fff00 req-92e9ba03-8a40-4f31-b411-8b6060e223b0 service nova] Releasing lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-133130086',display_name='tempest-ServerRescueNegativeTestJSON-server-133130086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-133130086',id=16,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-1niwqwea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:01Z,user_data=None,user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:0f:de,bridge_name='br-int',has_traffic_filtering=True,id=804687ae-e749-44ee-ada3-856923763b9b,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804687ae-e7') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:02 user nova-compute[75342]: DEBUG nova.objects.instance [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'pci_devices' on Instance uuid bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:03:03 user nova-compute[75342]:   <uuid>bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f</uuid>
Nov 16 18:03:03 user nova-compute[75342]:   <name>instance-00000010</name>
Nov 16 18:03:03 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:03:03 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:03:03 user nova-compute[75342]:   <metadata>
Nov 16 18:03:03 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:03:03 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:03:03 user nova-compute[75342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-133130086</nova:name>
Nov 16 18:03:03 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:03:02</nova:creationTime>
Nov 16 18:03:03 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:03:03 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:03:03 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:03:03 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:03:03 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:03:03 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:03:03 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:03:03 user nova-compute[75342]:       <nova:owner>
Nov 16 18:03:03 user nova-compute[75342]:         <nova:user uuid="0697a15cd0054cef90459da99a3fd8ec">tempest-ServerRescueNegativeTestJSON-935902109-project-member</nova:user>
Nov 16 18:03:03 user nova-compute[75342]:         <nova:project uuid="02d87f343b6e4dbead83e037619ae49c">tempest-ServerRescueNegativeTestJSON-935902109</nova:project>
Nov 16 18:03:03 user nova-compute[75342]:       </nova:owner>
Nov 16 18:03:03 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:03:03 user nova-compute[75342]:       <nova:ports>
Nov 16 18:03:03 user nova-compute[75342]:         <nova:port uuid="804687ae-e749-44ee-ada3-856923763b9b">
Nov 16 18:03:03 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 18:03:03 user nova-compute[75342]:         </nova:port>
Nov 16 18:03:03 user nova-compute[75342]:       </nova:ports>
Nov 16 18:03:03 user nova-compute[75342]:     </nova:instance>
Nov 16 18:03:03 user nova-compute[75342]:   </metadata>
Nov 16 18:03:03 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:03:03 user nova-compute[75342]:     <system>
Nov 16 18:03:03 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:03:03 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:03:03 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:03:03 user nova-compute[75342]:       <entry name="serial">bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f</entry>
Nov 16 18:03:03 user nova-compute[75342]:       <entry name="uuid">bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f</entry>
Nov 16 18:03:03 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:03:03 user nova-compute[75342]:     </system>
Nov 16 18:03:03 user nova-compute[75342]:   </sysinfo>
Nov 16 18:03:03 user nova-compute[75342]:   <os>
Nov 16 18:03:03 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:03:03 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:03:03 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:03:03 user nova-compute[75342]:   </os>
Nov 16 18:03:03 user nova-compute[75342]:   <features>
Nov 16 18:03:03 user nova-compute[75342]:     <acpi/>
Nov 16 18:03:03 user nova-compute[75342]:     <apic/>
Nov 16 18:03:03 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:03:03 user nova-compute[75342]:   </features>
Nov 16 18:03:03 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:03:03 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:03:03 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:03:03 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:03:03 user nova-compute[75342]:   </clock>
Nov 16 18:03:03 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:03:03 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:03:03 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:03:03 user nova-compute[75342]:   </cpu>
Nov 16 18:03:03 user nova-compute[75342]:   <devices>
Nov 16 18:03:03 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:03:03 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:03:03 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk"/>
Nov 16 18:03:03 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:03:03 user nova-compute[75342]:     </disk>
Nov 16 18:03:03 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:03:03 user nova-compute[75342]:       <mac address="fa:16:3e:b9:0f:de"/>
Nov 16 18:03:03 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:03:03 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:03:03 user nova-compute[75342]:       <target dev="tap804687ae-e7"/>
Nov 16 18:03:03 user nova-compute[75342]:     </interface>
Nov 16 18:03:03 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:03:03 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/console.log" append="off"/>
Nov 16 18:03:03 user nova-compute[75342]:     </serial>
Nov 16 18:03:03 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:03:03 user nova-compute[75342]:     <video>
Nov 16 18:03:03 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:03:03 user nova-compute[75342]:     </video>
Nov 16 18:03:03 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:03:03 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:03:03 user nova-compute[75342]:     </rng>
Nov 16 18:03:03 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:03:03 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:03:03 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:03:03 user nova-compute[75342]:     </memballoon>
Nov 16 18:03:03 user nova-compute[75342]:   </devices>
Nov 16 18:03:03 user nova-compute[75342]: </domain>
Nov 16 18:03:03 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-133130086',display_name='tempest-ServerRescueNegativeTestJSON-server-133130086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-133130086',id=16,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-1niwqwea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:01Z,user_data=None,user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:0f:de,bridge_name='br-int',has_traffic_filtering=True,id=804687ae-e749-44ee-ada3-856923763b9b,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804687ae-e7') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG os_vif [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:0f:de,bridge_name='br-int',has_traffic_filtering=True,id=804687ae-e749-44ee-ada3-856923763b9b,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804687ae-e7') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3fe137c-8707-54d6-9c4d-8c485a6a65f5', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap804687ae-e7, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap804687ae-e7, col_values=(('qos', UUID('188363ec-6b54-4aa7-929b-8f5a219705ec')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap804687ae-e7, col_values=(('external_ids', {'iface-id': '804687ae-e749-44ee-ada3-856923763b9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:0f:de', 'vm-uuid': 'bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:03 user nova-compute[75342]: INFO os_vif [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:0f:de,bridge_name='br-int',has_traffic_filtering=True,id=804687ae-e749-44ee-ada3-856923763b9b,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804687ae-e7')
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No VIF found with MAC fa:16:3e:b9:0f:de, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.network.neutron [req-f9116f78-5bc2-48e1-a79d-e06467c915d9 req-0de25ed2-ba0f-4592-90c7-7ca7bb5abb5d service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Updated VIF entry in instance network info cache for port 804687ae-e749-44ee-ada3-856923763b9b. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.network.neutron [req-f9116f78-5bc2-48e1-a79d-e06467c915d9 req-0de25ed2-ba0f-4592-90c7-7ca7bb5abb5d service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Updating instance_info_cache with network_info: [{"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f9116f78-5bc2-48e1-a79d-e06467c915d9 req-0de25ed2-ba0f-4592-90c7-7ca7bb5abb5d service nova] Releasing lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-758f31c2-972b-4763-b4de-02b8192ce583 req-48cc8ccc-261d-4d92-97a9-db4196009bf7 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-758f31c2-972b-4763-b4de-02b8192ce583 req-48cc8ccc-261d-4d92-97a9-db4196009bf7 service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-758f31c2-972b-4763-b4de-02b8192ce583 req-48cc8ccc-261d-4d92-97a9-db4196009bf7 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-758f31c2-972b-4763-b4de-02b8192ce583 req-48cc8ccc-261d-4d92-97a9-db4196009bf7 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-758f31c2-972b-4763-b4de-02b8192ce583 req-48cc8ccc-261d-4d92-97a9-db4196009bf7 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:03 user nova-compute[75342]: WARNING nova.compute.manager [req-758f31c2-972b-4763-b4de-02b8192ce583 req-48cc8ccc-261d-4d92-97a9-db4196009bf7 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received unexpected event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with vm_state building and task_state spawning.
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:03:03 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Instance spawned successfully.
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:03 user nova-compute[75342]: INFO nova.compute.manager [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 16 18:03:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:03:04 user nova-compute[75342]: INFO nova.compute.manager [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Took 19.14 seconds to build instance.
Nov 16 18:03:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-08e5f860-f0d0-4cc7-90f9-8c061892b19b tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.309s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:05 user nova-compute[75342]: WARNING nova.compute.manager [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received unexpected event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with vm_state building and task_state spawning.
Nov 16 18:03:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:05 user nova-compute[75342]: WARNING nova.compute.manager [req-cafb5ae3-6e28-470d-92bf-0a51e59a98e3 req-d1b13dac-9203-450a-a047-f5a4ae6255f4 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received unexpected event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with vm_state building and task_state spawning.
Nov 16 18:03:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] No waiting events found dispatching network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:07 user nova-compute[75342]: WARNING nova.compute.manager [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received unexpected event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b for instance with vm_state building and task_state spawning.
Nov 16 18:03:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] No waiting events found dispatching network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:07 user nova-compute[75342]: WARNING nova.compute.manager [req-82ab4333-f779-44a4-b700-5ca3221d68fd req-5106c544-b7e3-4368-82d3-871a8e854b05 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received unexpected event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b for instance with vm_state building and task_state spawning.
Nov 16 18:03:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:03:08 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Instance spawned successfully.
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:03:08 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Instance spawned successfully.
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:03:08 user nova-compute[75342]: INFO nova.compute.manager [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Took 7.90 seconds to spawn the instance on the hypervisor.
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:08 user nova-compute[75342]: INFO nova.compute.manager [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Took 9.52 seconds to build instance.
Nov 16 18:03:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-54c99746-8859-4e82-ae93-ae533831039e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.625s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:08 user nova-compute[75342]: INFO nova.compute.manager [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Took 7.12 seconds to spawn the instance on the hypervisor.
Nov 16 18:03:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:03:08 user nova-compute[75342]: INFO nova.compute.manager [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Took 8.99 seconds to build instance.
Nov 16 18:03:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-867cecfc-781a-4a26-9d9a-9d048845cf2e tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.098s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Acquiring lock "d057c823-fd25-45f9-ba3e-11a784f38064" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "d057c823-fd25-45f9-ba3e-11a784f38064" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Acquiring lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:10 user nova-compute[75342]: INFO nova.compute.manager [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Terminating instance
Nov 16 18:03:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-f2da67ec-daf3-4385-867f-ff18bf8d2535 req-6e1996b7-32b1-4440-9b26-163bd9b5669c service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Received event network-vif-unplugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f2da67ec-daf3-4385-867f-ff18bf8d2535 req-6e1996b7-32b1-4440-9b26-163bd9b5669c service nova] Acquiring lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f2da67ec-daf3-4385-867f-ff18bf8d2535 req-6e1996b7-32b1-4440-9b26-163bd9b5669c service nova] Lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f2da67ec-daf3-4385-867f-ff18bf8d2535 req-6e1996b7-32b1-4440-9b26-163bd9b5669c service nova] Lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-f2da67ec-daf3-4385-867f-ff18bf8d2535 req-6e1996b7-32b1-4440-9b26-163bd9b5669c service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] No waiting events found dispatching network-vif-unplugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-f2da67ec-daf3-4385-867f-ff18bf8d2535 req-6e1996b7-32b1-4440-9b26-163bd9b5669c service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Received event network-vif-unplugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:03:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:11 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Instance destroyed successfully.
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lazy-loading 'resources' on Instance uuid d057c823-fd25-45f9-ba3e-11a784f38064 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1293732500',display_name='tempest-VolumesAssistedSnapshotsTest-server-1293732500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1293732500',id=10,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETYGuphuHkflov/skUKewUKhVjUwvjV3Z/bWKfbCBFqBQiKlLk0LGivtsluo+tUOUn4g3xiQa00KVLKT2zoyR7IWTCXjpupa+0hfUUhDfXvMwa4y17V0BOrnqX7PhK0zQ==',key_name='tempest-keypair-1327000719',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7c15cbe30d84c4aade9097427271d20',ramdisk_id='',reservation_id='r-99i7ipsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-209870780',owner_user_name='tempest-VolumesAssistedSnapshotsTest-209870780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d04c2b3446604237b5a0c18092043d6d',uuid=d057c823-fd25-45f9-ba3e-11a784f38064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "address": "fa:16:3e:71:76:9d", "network": {"id": "d84baa34-4221-483e-9b50-d08061b235a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-733195092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7c15cbe30d84c4aade9097427271d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201ad806-d2", "ovs_interfaceid": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Converting VIF {"id": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "address": "fa:16:3e:71:76:9d", "network": {"id": "d84baa34-4221-483e-9b50-d08061b235a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-733195092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7c15cbe30d84c4aade9097427271d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201ad806-d2", "ovs_interfaceid": "201ad806-d285-4ca8-91f3-5df4ba73d7e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:76:9d,bridge_name='br-int',has_traffic_filtering=True,id=201ad806-d285-4ca8-91f3-5df4ba73d7e4,network=Network(d84baa34-4221-483e-9b50-d08061b235a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201ad806-d2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG os_vif [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:76:9d,bridge_name='br-int',has_traffic_filtering=True,id=201ad806-d285-4ca8-91f3-5df4ba73d7e4,network=Network(d84baa34-4221-483e-9b50-d08061b235a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201ad806-d2') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap201ad806-d2, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b54f810-f613-41af-8a1e-8cfd36e0dd94) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:11 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Waiting for libvirt event about the detach of device tape1665c78-86 with device alias net1 from instance 65e77fb1-8148-46a5-bc53-139b7ea096ad is timed out.
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a9:61:19"/><model type="virtio"/><mtu size="1442"/><target dev="tape1665c78-86"/></interface> {{(pid=75342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:11 user nova-compute[75342]: INFO os_vif [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:76:9d,bridge_name='br-int',has_traffic_filtering=True,id=201ad806-d285-4ca8-91f3-5df4ba73d7e4,network=Network(d84baa34-4221-483e-9b50-d08061b235a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201ad806-d2')
Nov 16 18:03:11 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Deleting instance files /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064_del
Nov 16 18:03:11 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Deletion of /opt/stack/data/nova/instances/d057c823-fd25-45f9-ba3e-11a784f38064_del complete
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a9:61:19"/><model type="virtio"/><mtu size="1442"/><target dev="tape1665c78-86"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 16 18:03:11 user nova-compute[75342]:   <name>instance-00000009</name>
Nov 16 18:03:11 user nova-compute[75342]:   <uuid>65e77fb1-8148-46a5-bc53-139b7ea096ad</uuid>
Nov 16 18:03:11 user nova-compute[75342]:   <metadata>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:03:11 user nova-compute[75342]:   <nova:package version="0.0.0"/>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:name>tempest-device-tagging-server-1632151976</nova:name>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:creationTime>2023-11-16 18:02:11</nova:creationTime>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:flavor name="m1.tiny">
Nov 16 18:03:11 user nova-compute[75342]:     <nova:memory>512</nova:memory>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:disk>1</nova:disk>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:swap>0</nova:swap>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:vcpus>1</nova:vcpus>
Nov 16 18:03:11 user nova-compute[75342]:   </nova:flavor>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:owner>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:user uuid="ff61915f003d41a4828ba719c2cfd0a2">tempest-TaggedAttachmentsTest-1574754300-project-member</nova:user>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:project uuid="a4063aba08ce4f1d9c22413cc4ac2775">tempest-TaggedAttachmentsTest-1574754300</nova:project>
Nov 16 18:03:11 user nova-compute[75342]:   </nova:owner>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:ports>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:port uuid="f1d3a970-40d8-420b-b632-c0231545cd41">
Nov 16 18:03:11 user nova-compute[75342]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 18:03:11 user nova-compute[75342]:     </nova:port>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:port uuid="e1665c78-8646-4a63-ac74-63d44bb0295a">
Nov 16 18:03:11 user nova-compute[75342]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 16 18:03:11 user nova-compute[75342]:     </nova:port>
Nov 16 18:03:11 user nova-compute[75342]:   </nova:ports>
Nov 16 18:03:11 user nova-compute[75342]: </nova:instance>
Nov 16 18:03:11 user nova-compute[75342]:   </metadata>
Nov 16 18:03:11 user nova-compute[75342]:   <memory unit='KiB'>524288</memory>
Nov 16 18:03:11 user nova-compute[75342]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 18:03:11 user nova-compute[75342]:   <vcpu placement='static'>1</vcpu>
Nov 16 18:03:11 user nova-compute[75342]:   <resource>
Nov 16 18:03:11 user nova-compute[75342]:     <partition>/machine</partition>
Nov 16 18:03:11 user nova-compute[75342]:   </resource>
Nov 16 18:03:11 user nova-compute[75342]:   <sysinfo type='smbios'>
Nov 16 18:03:11 user nova-compute[75342]:     <system>
Nov 16 18:03:11 user nova-compute[75342]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 18:03:11 user nova-compute[75342]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 18:03:11 user nova-compute[75342]:       <entry name='version'>0.0.0</entry>
Nov 16 18:03:11 user nova-compute[75342]:       <entry name='serial'>65e77fb1-8148-46a5-bc53-139b7ea096ad</entry>
Nov 16 18:03:11 user nova-compute[75342]:       <entry name='uuid'>65e77fb1-8148-46a5-bc53-139b7ea096ad</entry>
Nov 16 18:03:11 user nova-compute[75342]:       <entry name='family'>Virtual Machine</entry>
Nov 16 18:03:11 user nova-compute[75342]:     </system>
Nov 16 18:03:11 user nova-compute[75342]:   </sysinfo>
Nov 16 18:03:11 user nova-compute[75342]:   <os>
Nov 16 18:03:11 user nova-compute[75342]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 18:03:11 user nova-compute[75342]:     <boot dev='hd'/>
Nov 16 18:03:11 user nova-compute[75342]:     <smbios mode='sysinfo'/>
Nov 16 18:03:11 user nova-compute[75342]:   </os>
Nov 16 18:03:11 user nova-compute[75342]:   <features>
Nov 16 18:03:11 user nova-compute[75342]:     <acpi/>
Nov 16 18:03:11 user nova-compute[75342]:     <apic/>
Nov 16 18:03:11 user nova-compute[75342]:     <vmcoreinfo state='on'/>
Nov 16 18:03:11 user nova-compute[75342]:   </features>
Nov 16 18:03:11 user nova-compute[75342]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 18:03:11 user nova-compute[75342]:     <model fallback='forbid'>Nehalem</model>
Nov 16 18:03:11 user nova-compute[75342]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 18:03:11 user nova-compute[75342]:     <feature policy='require' name='vme'/>
Nov 16 18:03:11 user nova-compute[75342]:     <feature policy='require' name='x2apic'/>
Nov 16 18:03:11 user nova-compute[75342]:     <feature policy='require' name='hypervisor'/>
Nov 16 18:03:11 user nova-compute[75342]:   </cpu>
Nov 16 18:03:11 user nova-compute[75342]:   <clock offset='utc'>
Nov 16 18:03:11 user nova-compute[75342]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 18:03:11 user nova-compute[75342]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 18:03:11 user nova-compute[75342]:     <timer name='hpet' present='no'/>
Nov 16 18:03:11 user nova-compute[75342]:   </clock>
Nov 16 18:03:11 user nova-compute[75342]:   <on_poweroff>destroy</on_poweroff>
Nov 16 18:03:11 user nova-compute[75342]:   <on_reboot>restart</on_reboot>
Nov 16 18:03:11 user nova-compute[75342]:   <on_crash>destroy</on_crash>
Nov 16 18:03:11 user nova-compute[75342]:   <devices>
Nov 16 18:03:11 user nova-compute[75342]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 18:03:11 user nova-compute[75342]:     <disk type='file' device='disk'>
Nov 16 18:03:11 user nova-compute[75342]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 18:03:11 user nova-compute[75342]:       <source file='/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk' index='2'/>
Nov 16 18:03:11 user nova-compute[75342]:       <backingStore type='file' index='3'>
Nov 16 18:03:11 user nova-compute[75342]:         <format type='raw'/>
Nov 16 18:03:11 user nova-compute[75342]:         <source file='/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d'/>
Nov 16 18:03:11 user nova-compute[75342]:         <backingStore/>
Nov 16 18:03:11 user nova-compute[75342]:       </backingStore>
Nov 16 18:03:11 user nova-compute[75342]:       <target dev='vda' bus='virtio'/>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='virtio-disk0'/>
Nov 16 18:03:11 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 18:03:11 user nova-compute[75342]:     </disk>
Nov 16 18:03:11 user nova-compute[75342]:     <disk type='file' device='cdrom'>
Nov 16 18:03:11 user nova-compute[75342]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 18:03:11 user nova-compute[75342]:       <source file='/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk.config' index='1'/>
Nov 16 18:03:11 user nova-compute[75342]:       <backingStore/>
Nov 16 18:03:11 user nova-compute[75342]:       <target dev='hda' bus='ide'/>
Nov 16 18:03:11 user nova-compute[75342]:       <readonly/>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='ide0-0-0'/>
Nov 16 18:03:11 user nova-compute[75342]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 18:03:11 user nova-compute[75342]:     </disk>
Nov 16 18:03:11 user nova-compute[75342]:     <controller type='usb' index='0' model='none'>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='usb'/>
Nov 16 18:03:11 user nova-compute[75342]:     </controller>
Nov 16 18:03:11 user nova-compute[75342]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='pci.0'/>
Nov 16 18:03:11 user nova-compute[75342]:     </controller>
Nov 16 18:03:11 user nova-compute[75342]:     <controller type='ide' index='0'>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='ide'/>
Nov 16 18:03:11 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 18:03:11 user nova-compute[75342]:     </controller>
Nov 16 18:03:11 user nova-compute[75342]:     <interface type='ethernet'>
Nov 16 18:03:11 user nova-compute[75342]:       <mac address='fa:16:3e:c1:51:1f'/>
Nov 16 18:03:11 user nova-compute[75342]:       <target dev='tapf1d3a970-40'/>
Nov 16 18:03:11 user nova-compute[75342]:       <model type='virtio'/>
Nov 16 18:03:11 user nova-compute[75342]:       <mtu size='1442'/>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='net0'/>
Nov 16 18:03:11 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 18:03:11 user nova-compute[75342]:     </interface>
Nov 16 18:03:11 user nova-compute[75342]:     <serial type='pty'>
Nov 16 18:03:11 user nova-compute[75342]:       <source path='/dev/pts/7'/>
Nov 16 18:03:11 user nova-compute[75342]:       <log file='/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/console.log' append='off'/>
Nov 16 18:03:11 user nova-compute[75342]:       <target type='isa-serial' port='0'>
Nov 16 18:03:11 user nova-compute[75342]:         <model name='isa-serial'/>
Nov 16 18:03:11 user nova-compute[75342]:       </target>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='serial0'/>
Nov 16 18:03:11 user nova-compute[75342]:     </serial>
Nov 16 18:03:11 user nova-compute[75342]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 18:03:11 user nova-compute[75342]:       <source path='/dev/pts/7'/>
Nov 16 18:03:11 user nova-compute[75342]:       <log file='/opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/console.log' append='off'/>
Nov 16 18:03:11 user nova-compute[75342]:       <target type='serial' port='0'/>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='serial0'/>
Nov 16 18:03:11 user nova-compute[75342]:     </console>
Nov 16 18:03:11 user nova-compute[75342]:     <input type='mouse' bus='ps2'>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='input0'/>
Nov 16 18:03:11 user nova-compute[75342]:     </input>
Nov 16 18:03:11 user nova-compute[75342]:     <input type='keyboard' bus='ps2'>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='input1'/>
Nov 16 18:03:11 user nova-compute[75342]:     </input>
Nov 16 18:03:11 user nova-compute[75342]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 16 18:03:11 user nova-compute[75342]:       <listen type='address' address='0.0.0.0'/>
Nov 16 18:03:11 user nova-compute[75342]:     </graphics>
Nov 16 18:03:11 user nova-compute[75342]:     <audio id='1' type='none'/>
Nov 16 18:03:11 user nova-compute[75342]:     <video>
Nov 16 18:03:11 user nova-compute[75342]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='video0'/>
Nov 16 18:03:11 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 18:03:11 user nova-compute[75342]:     </video>
Nov 16 18:03:11 user nova-compute[75342]:     <memballoon model='virtio'>
Nov 16 18:03:11 user nova-compute[75342]:       <stats period='10'/>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='balloon0'/>
Nov 16 18:03:11 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 18:03:11 user nova-compute[75342]:     </memballoon>
Nov 16 18:03:11 user nova-compute[75342]:     <rng model='virtio'>
Nov 16 18:03:11 user nova-compute[75342]:       <backend model='random'>/dev/urandom</backend>
Nov 16 18:03:11 user nova-compute[75342]:       <alias name='rng0'/>
Nov 16 18:03:11 user nova-compute[75342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 18:03:11 user nova-compute[75342]:     </rng>
Nov 16 18:03:11 user nova-compute[75342]:   </devices>
Nov 16 18:03:11 user nova-compute[75342]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 18:03:11 user nova-compute[75342]:     <label>libvirt-65e77fb1-8148-46a5-bc53-139b7ea096ad</label>
Nov 16 18:03:11 user nova-compute[75342]:     <imagelabel>libvirt-65e77fb1-8148-46a5-bc53-139b7ea096ad</imagelabel>
Nov 16 18:03:11 user nova-compute[75342]:   </seclabel>
Nov 16 18:03:11 user nova-compute[75342]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 18:03:11 user nova-compute[75342]:     <label>+64055:+108</label>
Nov 16 18:03:11 user nova-compute[75342]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 18:03:11 user nova-compute[75342]:   </seclabel>
Nov 16 18:03:11 user nova-compute[75342]: </domain>
Nov 16 18:03:11 user nova-compute[75342]:  {{(pid=75342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 18:03:11 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Successfully detached device tape1665c78-86 from instance 65e77fb1-8148-46a5-bc53-139b7ea096ad from the live domain config.
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1632151976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1632151976',id=9,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzlRPxa4PAPm45PMmq6l0+fBK9hV73ZL6geqM+y/RLFGg/C77lh7irpPP6ckBjAuzTfCveRgeMZjCC7DsaDkkVKcV+qSujYvT8RzL81EPVckf4RjSVpsZxqrwxx8lsoJw==',key_name='tempest-keypair-1617085374',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4063aba08ce4f1d9c22413cc4ac2775',ramdisk_id='',reservation_id='r-ilc0wgmz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1574754300',owner_user_name='tempest-TaggedAttachmentsTest-1574754300-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61915f003d41a4828ba719c2cfd0a2',uuid=65e77fb1-8148-46a5-bc53-139b7ea096ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1665c78-8646-4a63-ac74-63d44bb0295a", "address": "fa:16:3e:a9:61:19", "network": {"id": "4cecbd03-4fda-4d73-a448-79b6109f21c5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-725026521", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1665c78-86", "ovs_interfaceid": "e1665c78-8646-4a63-ac74-63d44bb0295a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converting VIF {"id": "e1665c78-8646-4a63-ac74-63d44bb0295a", "address": "fa:16:3e:a9:61:19", "network": {"id": "4cecbd03-4fda-4d73-a448-79b6109f21c5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-725026521", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1665c78-86", "ovs_interfaceid": "e1665c78-8646-4a63-ac74-63d44bb0295a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:61:19,bridge_name='br-int',has_traffic_filtering=True,id=e1665c78-8646-4a63-ac74-63d44bb0295a,network=Network(4cecbd03-4fda-4d73-a448-79b6109f21c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1665c78-86') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG os_vif [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:61:19,bridge_name='br-int',has_traffic_filtering=True,id=e1665c78-8646-4a63-ac74-63d44bb0295a,network=Network(4cecbd03-4fda-4d73-a448-79b6109f21c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1665c78-86') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1665c78-86, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5a186b8-cb38-48ce-a0f4-23401bf270d4) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:11 user nova-compute[75342]: INFO os_vif [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:61:19,bridge_name='br-int',has_traffic_filtering=True,id=e1665c78-8646-4a63-ac74-63d44bb0295a,network=Network(4cecbd03-4fda-4d73-a448-79b6109f21c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1665c78-86')
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:03:11 user nova-compute[75342]:   <nova:package version="0.0.0"/>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:name>tempest-device-tagging-server-1632151976</nova:name>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:creationTime>2023-11-16 18:03:11</nova:creationTime>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:flavor name="m1.tiny">
Nov 16 18:03:11 user nova-compute[75342]:     <nova:memory>512</nova:memory>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:disk>1</nova:disk>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:swap>0</nova:swap>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:vcpus>1</nova:vcpus>
Nov 16 18:03:11 user nova-compute[75342]:   </nova:flavor>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:owner>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:user uuid="ff61915f003d41a4828ba719c2cfd0a2">tempest-TaggedAttachmentsTest-1574754300-project-member</nova:user>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:project uuid="a4063aba08ce4f1d9c22413cc4ac2775">tempest-TaggedAttachmentsTest-1574754300</nova:project>
Nov 16 18:03:11 user nova-compute[75342]:   </nova:owner>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:03:11 user nova-compute[75342]:   <nova:ports>
Nov 16 18:03:11 user nova-compute[75342]:     <nova:port uuid="f1d3a970-40d8-420b-b632-c0231545cd41">
Nov 16 18:03:11 user nova-compute[75342]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 18:03:11 user nova-compute[75342]:     </nova:port>
Nov 16 18:03:11 user nova-compute[75342]:   </nova:ports>
Nov 16 18:03:11 user nova-compute[75342]: </nova:instance>
Nov 16 18:03:11 user nova-compute[75342]:  {{(pid=75342) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 18:03:11 user nova-compute[75342]: INFO nova.compute.manager [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 16 18:03:11 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquired lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.network.neutron [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-66cbfa92-70fb-45c5-911d-70f6994c3dc0 req-fdacdea8-5af5-43d1-beb6-28cc8eb9ae5d service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Received event network-vif-deleted-201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:11 user nova-compute[75342]: INFO nova.compute.manager [req-66cbfa92-70fb-45c5-911d-70f6994c3dc0 req-fdacdea8-5af5-43d1-beb6-28cc8eb9ae5d service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Neutron deleted interface 201ad806-d285-4ca8-91f3-5df4ba73d7e4; detaching it from the instance and deleting it from the info cache
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.network.neutron [req-66cbfa92-70fb-45c5-911d-70f6994c3dc0 req-fdacdea8-5af5-43d1-beb6-28cc8eb9ae5d service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:11 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Took 0.77 seconds to deallocate network for instance.
Nov 16 18:03:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-66cbfa92-70fb-45c5-911d-70f6994c3dc0 req-fdacdea8-5af5-43d1-beb6-28cc8eb9ae5d service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Detach interface failed, port_id=201ad806-d285-4ca8-91f3-5df4ba73d7e4, reason: Instance d057c823-fd25-45f9-ba3e-11a784f38064 could not be found. {{(pid=75342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:03:12 user nova-compute[75342]: INFO nova.network.neutron [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Port e1665c78-8646-4a63-ac74-63d44bb0295a from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 16 18:03:12 user nova-compute[75342]: DEBUG nova.network.neutron [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Updating instance_info_cache with network_info: [{"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Releasing lock "refresh_cache-65e77fb1-8148-46a5-bc53-139b7ea096ad" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-005ed5d6-3fe0-4fdd-9495-97a1ed35573d tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "interface-65e77fb1-8148-46a5-bc53-139b7ea096ad-e1665c78-8646-4a63-ac74-63d44bb0295a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.951s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG nova.compute.manager [req-df369fcf-f144-44a4-b391-150ac972a938 req-11a3eef4-cd72-452d-b670-272f87936be0 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Received event network-vif-plugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-df369fcf-f144-44a4-b391-150ac972a938 req-11a3eef4-cd72-452d-b670-272f87936be0 service nova] Acquiring lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-df369fcf-f144-44a4-b391-150ac972a938 req-11a3eef4-cd72-452d-b670-272f87936be0 service nova] Lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-df369fcf-f144-44a4-b391-150ac972a938 req-11a3eef4-cd72-452d-b670-272f87936be0 service nova] Lock "d057c823-fd25-45f9-ba3e-11a784f38064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG nova.compute.manager [req-df369fcf-f144-44a4-b391-150ac972a938 req-11a3eef4-cd72-452d-b670-272f87936be0 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] No waiting events found dispatching network-vif-plugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:12 user nova-compute[75342]: WARNING nova.compute.manager [req-df369fcf-f144-44a4-b391-150ac972a938 req-11a3eef4-cd72-452d-b670-272f87936be0 service nova] [instance: d057c823-fd25-45f9-ba3e-11a784f38064] Received unexpected event network-vif-plugged-201ad806-d285-4ca8-91f3-5df4ba73d7e4 for instance with vm_state deleted and task_state None.
Nov 16 18:03:12 user nova-compute[75342]: DEBUG nova.compute.manager [req-df369fcf-f144-44a4-b391-150ac972a938 req-11a3eef4-cd72-452d-b670-272f87936be0 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-vif-deleted-e1665c78-8646-4a63-ac74-63d44bb0295a {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:12 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Deleted allocations for instance d057c823-fd25-45f9-ba3e-11a784f38064
Nov 16 18:03:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b46e74f8-a0e4-4c01-a06e-f6f1414d7ad4 tempest-VolumesAssistedSnapshotsTest-209870780 tempest-VolumesAssistedSnapshotsTest-209870780-project-member] Lock "d057c823-fd25-45f9-ba3e-11a784f38064" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.552s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:14 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07c92356-fdd3-4884-b406-55c92c63db18 is timed out.
Nov 16 18:03:14 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Successfully detached device vdb from instance 07c92356-fdd3-4884-b406-55c92c63db18 from the live domain config.
Nov 16 18:03:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMaZWImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'a05c843f-c695-449f-baf7-d4b8559db14c'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:03:14 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be91b5e-105b-432f-a287-93bc9e399cd5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:03:14 user nova-compute[75342]: No targets found.
Nov 16 18:03:14 user nova-compute[75342]: iSNS:
Nov 16 18:03:14 user nova-compute[75342]: No targets found.
Nov 16 18:03:14 user nova-compute[75342]: STATIC:
Nov 16 18:03:14 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c
Nov 16 18:03:14 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:03:14 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:03:14 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:03:14 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:03:14 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:03:14 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea
Nov 16 18:03:14 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:03:14 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:03:14 user nova-compute[75342]: FIRMWARE:
Nov 16 18:03:14 user nova-compute[75342]: No targets found.
Nov 16 18:03:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:03:14 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:03:14 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aced535f-0d1b-43f1-bdf2-edbadbcf36d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[262a7582-8969-48c0-8262-e15e5dbccd3e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:03:14 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:03:14 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:03:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c (non-flash)
Nov 16 18:03:14 user nova-compute[75342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:03:14 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:03:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a46309d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[827bcc95-fadc-497d-8e28-8ddfe7a5e50f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c355e34c-0664-4583-91a6-9c57514843b1]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c861b903-dd15-4b49-89e3-394cc619e92c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8e4a47-86cb-4c33-b3e1-05cf6d383d65]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2720ed-de44-497c-bdf2-8619574f46ee]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff531e7b-db4a-43d5-98e5-4360c99ead91]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260]
Nov 16 18:03:14 user nova-compute[75342]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c, portal: 172.16.0.220,3260] successful.
Nov 16 18:03:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05c843f-c695-449f-baf7-d4b8559db14c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[740473da-958e-4772-881c-c71ab6a9f2da]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] <== disconnect_volume: return (296ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:03:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:03:15 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lazy-loading 'flavor' on Instance uuid 07c92356-fdd3-4884-b406-55c92c63db18 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:03:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1972c0df-d9b3-489b-b4d8-afe805f6576e tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.943s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:27 user nova-compute[75342]: DEBUG nova.compute.manager [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:03:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:27 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:03:27 user nova-compute[75342]: INFO nova.compute.claims [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Claim successful on node user
Nov 16 18:03:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG nova.network.neutron [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:03:28 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:03:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG nova.policy [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1794b9bef4ad42e6aab088f3ef90dba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78cae892fff433eb216caff3a127a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:03:28 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Creating image(s)
Nov 16 18:03:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "/opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "/opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "/opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.210s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.200s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk 1073741824" returned: 0 in 0.058s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.202s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG nova.network.neutron [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Successfully created port: f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Cannot resize image /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Ensure instance console log exists: /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:29 user nova-compute[75342]: DEBUG nova.network.neutron [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Successfully updated port: f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "refresh_cache-28eaadcb-3f00-4868-8115-b5d4ba9454f3" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquired lock "refresh_cache-28eaadcb-3f00-4868-8115-b5d4ba9454f3" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.network.neutron [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-a2f572b3-0671-4252-b6f2-a9b1230fdebd req-7d53a403-8321-4eea-909c-09b0e6923098 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-changed-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-a2f572b3-0671-4252-b6f2-a9b1230fdebd req-7d53a403-8321-4eea-909c-09b0e6923098 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Refreshing instance network info cache due to event network-changed-f10735e2-a261-4be2-9fc4-2ae2622116b1. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2f572b3-0671-4252-b6f2-a9b1230fdebd req-7d53a403-8321-4eea-909c-09b0e6923098 service nova] Acquiring lock "refresh_cache-28eaadcb-3f00-4868-8115-b5d4ba9454f3" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.network.neutron [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.network.neutron [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Updating instance_info_cache with network_info: [{"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Releasing lock "refresh_cache-28eaadcb-3f00-4868-8115-b5d4ba9454f3" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.compute.manager [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Instance network_info: |[{"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2f572b3-0671-4252-b6f2-a9b1230fdebd req-7d53a403-8321-4eea-909c-09b0e6923098 service nova] Acquired lock "refresh_cache-28eaadcb-3f00-4868-8115-b5d4ba9454f3" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.network.neutron [req-a2f572b3-0671-4252-b6f2-a9b1230fdebd req-7d53a403-8321-4eea-909c-09b0e6923098 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Refreshing network info cache for port f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Start _get_guest_xml network_info=[{"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:03:30 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:03:30 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-887107635',display_name='tempest-tempest.common.compute-instance-887107635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-887107635',id=17,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfwGnGzjoPuBYsLqsfQN6FM2vWnqcustRrTtZq3OicWLSB8yxCZthWTbl8eXWTXVUw2kpzZCI19a2sTDkWmNjVlQEF1Pk/zLU8VOzU8Glz1gUKzzWAUC1g4Kb4M6bYDqQ==',key_name='tempest-keypair-1194151370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-8109rq0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=28eaadcb-3f00-4868-8115-b5d4ba9454f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.objects.instance [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'pci_devices' on Instance uuid 28eaadcb-3f00-4868-8115-b5d4ba9454f3 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:03:30 user nova-compute[75342]:   <uuid>28eaadcb-3f00-4868-8115-b5d4ba9454f3</uuid>
Nov 16 18:03:30 user nova-compute[75342]:   <name>instance-00000011</name>
Nov 16 18:03:30 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:03:30 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:03:30 user nova-compute[75342]:   <metadata>
Nov 16 18:03:30 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:03:30 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:03:30 user nova-compute[75342]:       <nova:name>tempest-tempest.common.compute-instance-887107635</nova:name>
Nov 16 18:03:30 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:03:30</nova:creationTime>
Nov 16 18:03:30 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:03:30 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:03:30 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:03:30 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:03:30 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:03:30 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:03:30 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:03:30 user nova-compute[75342]:       <nova:owner>
Nov 16 18:03:30 user nova-compute[75342]:         <nova:user uuid="1794b9bef4ad42e6aab088f3ef90dba2">tempest-ServerActionsTestOtherA-1650562087-project-member</nova:user>
Nov 16 18:03:30 user nova-compute[75342]:         <nova:project uuid="c78cae892fff433eb216caff3a127a64">tempest-ServerActionsTestOtherA-1650562087</nova:project>
Nov 16 18:03:30 user nova-compute[75342]:       </nova:owner>
Nov 16 18:03:30 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:03:30 user nova-compute[75342]:       <nova:ports>
Nov 16 18:03:30 user nova-compute[75342]:         <nova:port uuid="f10735e2-a261-4be2-9fc4-2ae2622116b1">
Nov 16 18:03:30 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 18:03:30 user nova-compute[75342]:         </nova:port>
Nov 16 18:03:30 user nova-compute[75342]:       </nova:ports>
Nov 16 18:03:30 user nova-compute[75342]:     </nova:instance>
Nov 16 18:03:30 user nova-compute[75342]:   </metadata>
Nov 16 18:03:30 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:03:30 user nova-compute[75342]:     <system>
Nov 16 18:03:30 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:03:30 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:03:30 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:03:30 user nova-compute[75342]:       <entry name="serial">28eaadcb-3f00-4868-8115-b5d4ba9454f3</entry>
Nov 16 18:03:30 user nova-compute[75342]:       <entry name="uuid">28eaadcb-3f00-4868-8115-b5d4ba9454f3</entry>
Nov 16 18:03:30 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:03:30 user nova-compute[75342]:     </system>
Nov 16 18:03:30 user nova-compute[75342]:   </sysinfo>
Nov 16 18:03:30 user nova-compute[75342]:   <os>
Nov 16 18:03:30 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:03:30 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:03:30 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:03:30 user nova-compute[75342]:   </os>
Nov 16 18:03:30 user nova-compute[75342]:   <features>
Nov 16 18:03:30 user nova-compute[75342]:     <acpi/>
Nov 16 18:03:30 user nova-compute[75342]:     <apic/>
Nov 16 18:03:30 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:03:30 user nova-compute[75342]:   </features>
Nov 16 18:03:30 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:03:30 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:03:30 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:03:30 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:03:30 user nova-compute[75342]:   </clock>
Nov 16 18:03:30 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:03:30 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:03:30 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:03:30 user nova-compute[75342]:   </cpu>
Nov 16 18:03:30 user nova-compute[75342]:   <devices>
Nov 16 18:03:30 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:03:30 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:03:30 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk"/>
Nov 16 18:03:30 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:03:30 user nova-compute[75342]:     </disk>
Nov 16 18:03:30 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:03:30 user nova-compute[75342]:       <mac address="fa:16:3e:3c:3d:18"/>
Nov 16 18:03:30 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:03:30 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:03:30 user nova-compute[75342]:       <target dev="tapf10735e2-a2"/>
Nov 16 18:03:30 user nova-compute[75342]:     </interface>
Nov 16 18:03:30 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:03:30 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/console.log" append="off"/>
Nov 16 18:03:30 user nova-compute[75342]:     </serial>
Nov 16 18:03:30 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:03:30 user nova-compute[75342]:     <video>
Nov 16 18:03:30 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:03:30 user nova-compute[75342]:     </video>
Nov 16 18:03:30 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:03:30 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:03:30 user nova-compute[75342]:     </rng>
Nov 16 18:03:30 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:03:30 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:03:30 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:03:30 user nova-compute[75342]:     </memballoon>
Nov 16 18:03:30 user nova-compute[75342]:   </devices>
Nov 16 18:03:30 user nova-compute[75342]: </domain>
Nov 16 18:03:30 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-887107635',display_name='tempest-tempest.common.compute-instance-887107635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-887107635',id=17,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfwGnGzjoPuBYsLqsfQN6FM2vWnqcustRrTtZq3OicWLSB8yxCZthWTbl8eXWTXVUw2kpzZCI19a2sTDkWmNjVlQEF1Pk/zLU8VOzU8Glz1gUKzzWAUC1g4Kb4M6bYDqQ==',key_name='tempest-keypair-1194151370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-8109rq0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=28eaadcb-3f00-4868-8115-b5d4ba9454f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG os_vif [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dce3653-527f-59c2-ad62-8176dd3bb57e', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf10735e2-a2, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf10735e2-a2, col_values=(('qos', UUID('e71ff046-638a-4770-b3cd-272a5460e777')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf10735e2-a2, col_values=(('external_ids', {'iface-id': 'f10735e2-a261-4be2-9fc4-2ae2622116b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:3d:18', 'vm-uuid': '28eaadcb-3f00-4868-8115-b5d4ba9454f3'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:30 user nova-compute[75342]: INFO os_vif [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2')
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No VIF found with MAC fa:16:3e:3c:3d:18, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.network.neutron [req-a2f572b3-0671-4252-b6f2-a9b1230fdebd req-7d53a403-8321-4eea-909c-09b0e6923098 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Updated VIF entry in instance network info cache for port f10735e2-a261-4be2-9fc4-2ae2622116b1. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG nova.network.neutron [req-a2f572b3-0671-4252-b6f2-a9b1230fdebd req-7d53a403-8321-4eea-909c-09b0e6923098 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Updating instance_info_cache with network_info: [{"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2f572b3-0671-4252-b6f2-a9b1230fdebd req-7d53a403-8321-4eea-909c-09b0e6923098 service nova] Releasing lock "refresh_cache-28eaadcb-3f00-4868-8115-b5d4ba9454f3" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-d53eac95-d5b4-4243-bdcc-635b6636ce4a req-8d8ca1e1-21ce-44f3-ad38-6bfc22856c82 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d53eac95-d5b4-4243-bdcc-635b6636ce4a req-8d8ca1e1-21ce-44f3-ad38-6bfc22856c82 service nova] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d53eac95-d5b4-4243-bdcc-635b6636ce4a req-8d8ca1e1-21ce-44f3-ad38-6bfc22856c82 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d53eac95-d5b4-4243-bdcc-635b6636ce4a req-8d8ca1e1-21ce-44f3-ad38-6bfc22856c82 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-d53eac95-d5b4-4243-bdcc-635b6636ce4a req-8d8ca1e1-21ce-44f3-ad38-6bfc22856c82 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] No waiting events found dispatching network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:32 user nova-compute[75342]: WARNING nova.compute.manager [req-d53eac95-d5b4-4243-bdcc-635b6636ce4a req-8d8ca1e1-21ce-44f3-ad38-6bfc22856c82 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received unexpected event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 for instance with vm_state building and task_state spawning.
Nov 16 18:03:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.compute.manager [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:03:34 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Instance spawned successfully.
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:03:34 user nova-compute[75342]: INFO nova.compute.manager [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.compute.manager [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-978134ad-6c23-4b29-a620-2c6045b56770 req-408bc46a-934c-44ee-beed-1a19414c4297 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-978134ad-6c23-4b29-a620-2c6045b56770 req-408bc46a-934c-44ee-beed-1a19414c4297 service nova] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-978134ad-6c23-4b29-a620-2c6045b56770 req-408bc46a-934c-44ee-beed-1a19414c4297 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-978134ad-6c23-4b29-a620-2c6045b56770 req-408bc46a-934c-44ee-beed-1a19414c4297 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-978134ad-6c23-4b29-a620-2c6045b56770 req-408bc46a-934c-44ee-beed-1a19414c4297 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] No waiting events found dispatching network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:34 user nova-compute[75342]: WARNING nova.compute.manager [req-978134ad-6c23-4b29-a620-2c6045b56770 req-408bc46a-934c-44ee-beed-1a19414c4297 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received unexpected event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 for instance with vm_state building and task_state spawning.
Nov 16 18:03:34 user nova-compute[75342]: INFO nova.compute.manager [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Took 6.83 seconds to build instance.
Nov 16 18:03:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-63e541e6-dd3c-4c4b-9bab-3be3d62627dc tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.947s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:35 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:03:35 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:03:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:35 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:03:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG nova.objects.instance [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lazy-loading 'flavor' on Instance uuid 2992b5fc-86e6-425f-82e5-cf6358582872 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:36 user nova-compute[75342]: INFO nova.compute.manager [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Attaching volume a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd to /dev/vdb
Nov 16 18:03:36 user nova-compute[75342]: DEBUG os_brick.utils [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[011490fb-acfa-4959-95f1-b7d7b0325c22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating instance_info_cache with network_info: [{"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40dcbb2-9aa7-4ed4-bd19-31bc8c698632]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f804bf-79c3-4971-888f-c1b625f92e98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb69c0eb-05f3-4f07-921d-ca8cf2546a82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:03:36 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91f314a-9b67-4779-860e-a338903e2648]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG os_brick.utils [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating existing volume attachment record: 990c8827-1f42-4d51-b50e-f457580cf625 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:03:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:41 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:03:41 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7348MB free_disk=25.482749938964844GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:41 user nova-compute[75342]: INFO nova.compute.manager [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Terminating instance
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.manager [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 2992b5fc-86e6-425f-82e5-cf6358582872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance a04eb165-88b6-4826-a4ac-c1bc51a57ba5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 07c92356-fdd3-4884-b406-55c92c63db18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 65e77fb1-8148-46a5-bc53-139b7ea096ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 2b4221b3-7f0d-4299-8bf2-865a46133a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-ae2bd789-0b1e-4e7b-accb-d2e53696c79c req-72d89f78-375f-4934-84ad-e7a4956018d0 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-vif-unplugged-f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ae2bd789-0b1e-4e7b-accb-d2e53696c79c req-72d89f78-375f-4934-84ad-e7a4956018d0 service nova] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ae2bd789-0b1e-4e7b-accb-d2e53696c79c req-72d89f78-375f-4934-84ad-e7a4956018d0 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ae2bd789-0b1e-4e7b-accb-d2e53696c79c req-72d89f78-375f-4934-84ad-e7a4956018d0 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-ae2bd789-0b1e-4e7b-accb-d2e53696c79c req-72d89f78-375f-4934-84ad-e7a4956018d0 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] No waiting events found dispatching network-vif-unplugged-f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-ae2bd789-0b1e-4e7b-accb-d2e53696c79c req-72d89f78-375f-4934-84ad-e7a4956018d0 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-vif-unplugged-f1d3a970-40d8-420b-b632-c0231545cd41 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrZWgwTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:03:42 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:03:42 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:03:42 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3139a0a0-ee94-43d5-a9c8-fa1f689103fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:03:42 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[618ee27b-482f-41c5-bb7a-18baf5451037]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd] added
Nov 16 18:03:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3159880c-728e-43c8-8f6a-95a3ecf9feaf]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5556bd17-5d9c-499c-9688-228ebaf06e88]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrZWgwTd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrZWgwTd" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b7767b-a72f-4c34-b5e3-90c364c9e80b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UrZWgwTd'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[461a9215-1594-4f93-a746-c968cd2e886c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[770f7514-187d-4c15-be90-487d292268c0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:03:42 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:03:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:03:42 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:03:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a418f0f4-153f-4521-8325-f0de8b783264]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]
Nov 16 18:03:42 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.
Nov 16 18:03:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8724a9ee-d9f2-4477-b4f2-11c6e4f864f7]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0463c0-fb46-443c-a7b1-8a8b3db1ad72]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:03:42 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:03:42 user nova-compute[75342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:03:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:03:42 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:03:42 user nova-compute[75342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:03:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec5e03a-2517-4573-8a4d-bd37ae08b9fa]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrZWgwTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:03:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Instance destroyed successfully.
Nov 16 18:03:42 user nova-compute[75342]: DEBUG nova.objects.instance [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lazy-loading 'resources' on Instance uuid 65e77fb1-8148-46a5-bc53-139b7ea096ad {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.862s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1632151976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1632151976',id=9,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzlRPxa4PAPm45PMmq6l0+fBK9hV73ZL6geqM+y/RLFGg/C77lh7irpPP6ckBjAuzTfCveRgeMZjCC7DsaDkkVKcV+qSujYvT8RzL81EPVckf4RjSVpsZxqrwxx8lsoJw==',key_name='tempest-keypair-1617085374',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4063aba08ce4f1d9c22413cc4ac2775',ramdisk_id='',reservation_id='r-ilc0wgmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1574754300',owner_user_name='tempest-TaggedAttachmentsTest-1574754300-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61915f003d41a4828ba719c2cfd0a2',uuid=65e77fb1-8148-46a5-bc53-139b7ea096ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converting VIF {"id": "f1d3a970-40d8-420b-b632-c0231545cd41", "address": "fa:16:3e:c1:51:1f", "network": {"id": "d47cc6c9-d413-44b3-9720-fe031f9a1ddd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-789271956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4063aba08ce4f1d9c22413cc4ac2775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d3a970-40", "ovs_interfaceid": "f1d3a970-40d8-420b-b632-c0231545cd41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:51:1f,bridge_name='br-int',has_traffic_filtering=True,id=f1d3a970-40d8-420b-b632-c0231545cd41,network=Network(d47cc6c9-d413-44b3-9720-fe031f9a1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d3a970-40') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG os_vif [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:51:1f,bridge_name='br-int',has_traffic_filtering=True,id=f1d3a970-40d8-420b-b632-c0231545cd41,network=Network(d47cc6c9-d413-44b3-9720-fe031f9a1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d3a970-40') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1d3a970-40, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d7952ec-dbce-49ef-8047-d9e3c545eb1c) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:42 user nova-compute[75342]: INFO os_vif [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:51:1f,bridge_name='br-int',has_traffic_filtering=True,id=f1d3a970-40d8-420b-b632-c0231545cd41,network=Network(d47cc6c9-d413-44b3-9720-fe031f9a1ddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d3a970-40')
Nov 16 18:03:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Deleting instance files /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad_del
Nov 16 18:03:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Deletion of /opt/stack/data/nova/instances/65e77fb1-8148-46a5-bc53-139b7ea096ad_del complete
Nov 16 18:03:42 user nova-compute[75342]: INFO nova.compute.manager [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 16 18:03:42 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:03:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:03:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23130356636653034', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:03:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130356636653034', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:03:43 user nova-compute[75342]: DEBUG nova.objects.instance [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lazy-loading 'flavor' on Instance uuid 2992b5fc-86e6-425f-82e5-cf6358582872 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:03:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:03:43 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:03:43 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:03:43 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:03:43 user nova-compute[75342]:   <serial>a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd</serial>
Nov 16 18:03:43 user nova-compute[75342]: </disk>
Nov 16 18:03:43 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:03:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:43 user nova-compute[75342]: INFO nova.compute.manager [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Terminating instance
Nov 16 18:03:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] No VIF found with MAC fa:16:3e:f5:5a:de, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-67253bad-2931-43b5-b6cb-7594e256cf0a req-07adde90-ce46-4ed2-b28a-2586efe88973 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-vif-plugged-f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-67253bad-2931-43b5-b6cb-7594e256cf0a req-07adde90-ce46-4ed2-b28a-2586efe88973 service nova] Acquiring lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-67253bad-2931-43b5-b6cb-7594e256cf0a req-07adde90-ce46-4ed2-b28a-2586efe88973 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-67253bad-2931-43b5-b6cb-7594e256cf0a req-07adde90-ce46-4ed2-b28a-2586efe88973 service nova] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-67253bad-2931-43b5-b6cb-7594e256cf0a req-07adde90-ce46-4ed2-b28a-2586efe88973 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] No waiting events found dispatching network-vif-plugged-f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:44 user nova-compute[75342]: WARNING nova.compute.manager [req-67253bad-2931-43b5-b6cb-7594e256cf0a req-07adde90-ce46-4ed2-b28a-2586efe88973 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received unexpected event network-vif-plugged-f1d3a970-40d8-420b-b632-c0231545cd41 for instance with vm_state active and task_state deleting.
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:44 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Took 1.54 seconds to deallocate network for instance.
Nov 16 18:03:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a1b31164-24c9-448a-bdfe-0633edaaeac8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.029s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Instance destroyed successfully.
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.objects.instance [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lazy-loading 'resources' on Instance uuid 07c92356-fdd3-4884-b406-55c92c63db18 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1175682526',display_name='tempest-TestVolumeSwap-server-1175682526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1175682526',id=8,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBURat+3hMRexJu9i4RhQh3IfN89dWyr95NKfnV7lN2vJH2ONnSJntUmX9bOtwpJuzgd282k9RiVpfSqTBFpIqNwghB0U5S/8IkU8GdG9dCd5kVoeq3cbxG6GOA54SE7nw==',key_name='tempest-keypair-1553058022',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='814d89f59bb949e7ad42a2d17774868c',ramdisk_id='',reservation_id='r-u0wixwti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-397535750',owner_user_name='tempest-TestVolumeSwap-397535750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:00:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb168b1c44c74c4a944a2a442fddd02f',uuid=07c92356-fdd3-4884-b406-55c92c63db18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "address": "fa:16:3e:a2:09:b8", "network": {"id": "1581948e-40b3-4da2-8d21-7884b3e60f82", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2010698692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "814d89f59bb949e7ad42a2d17774868c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d8866e3-1d", "ovs_interfaceid": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Converting VIF {"id": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "address": "fa:16:3e:a2:09:b8", "network": {"id": "1581948e-40b3-4da2-8d21-7884b3e60f82", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2010698692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "814d89f59bb949e7ad42a2d17774868c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d8866e3-1d", "ovs_interfaceid": "5d8866e3-1d92-45b7-bdb9-aa00d8a6e402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:09:b8,bridge_name='br-int',has_traffic_filtering=True,id=5d8866e3-1d92-45b7-bdb9-aa00d8a6e402,network=Network(1581948e-40b3-4da2-8d21-7884b3e60f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d8866e3-1d') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG os_vif [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:09:b8,bridge_name='br-int',has_traffic_filtering=True,id=5d8866e3-1d92-45b7-bdb9-aa00d8a6e402,network=Network(1581948e-40b3-4da2-8d21-7884b3e60f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d8866e3-1d') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d8866e3-1d, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=297e2ed7-6f6b-45e8-9589-00016019b556) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:44 user nova-compute[75342]: INFO os_vif [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:09:b8,bridge_name='br-int',has_traffic_filtering=True,id=5d8866e3-1d92-45b7-bdb9-aa00d8a6e402,network=Network(1581948e-40b3-4da2-8d21-7884b3e60f82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d8866e3-1d')
Nov 16 18:03:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Deleting instance files /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18_del
Nov 16 18:03:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Deletion of /opt/stack/data/nova/instances/07c92356-fdd3-4884-b406-55c92c63db18_del complete
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:03:44 user nova-compute[75342]: INFO nova.compute.manager [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 16 18:03:44 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:03:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.581s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:44 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Deleted allocations for instance 65e77fb1-8148-46a5-bc53-139b7ea096ad
Nov 16 18:03:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e6e66a5-2e29-4d7a-b410-e473bdbad425 tempest-TaggedAttachmentsTest-1574754300 tempest-TaggedAttachmentsTest-1574754300-project-member] Lock "65e77fb1-8148-46a5-bc53-139b7ea096ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.404s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 65e77fb1-8148-46a5-bc53-139b7ea096ad] Received event network-vif-deleted-f1d3a970-40d8-420b-b632-c0231545cd41 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-vif-unplugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] No waiting events found dispatching network-vif-unplugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-vif-unplugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] No waiting events found dispatching network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:46 user nova-compute[75342]: WARNING nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received unexpected event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 for instance with vm_state active and task_state deleting.
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] No waiting events found dispatching network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:46 user nova-compute[75342]: WARNING nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received unexpected event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 for instance with vm_state active and task_state deleting.
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] No waiting events found dispatching network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:46 user nova-compute[75342]: WARNING nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received unexpected event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 for instance with vm_state active and task_state deleting.
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-vif-unplugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] No waiting events found dispatching network-vif-unplugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-vif-unplugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Acquiring lock "07c92356-fdd3-4884-b406-55c92c63db18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] Lock "07c92356-fdd3-4884-b406-55c92c63db18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] No waiting events found dispatching network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:46 user nova-compute[75342]: WARNING nova.compute.manager [req-665ef44d-4cee-4962-946d-585f999b19bd req-8a0898d4-ba47-4c9f-bbfe-677b62620c39 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received unexpected event network-vif-plugged-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 for instance with vm_state active and task_state deleting.
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:46 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Took 1.45 seconds to deallocate network for instance.
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:46 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Deleted allocations for instance 07c92356-fdd3-4884-b406-55c92c63db18
Nov 16 18:03:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-226dedc6-cff3-4cce-aa92-f6e34d0e967f tempest-TestVolumeSwap-397535750 tempest-TestVolumeSwap-397535750-project-member] Lock "07c92356-fdd3-4884-b406-55c92c63db18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.159s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:47 user nova-compute[75342]: DEBUG nova.compute.manager [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Stashing vm_state: active {{(pid=75342) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 18:03:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:03:47 user nova-compute[75342]: INFO nova.compute.claims [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Claim successful on node user
Nov 16 18:03:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:47 user nova-compute[75342]: INFO nova.compute.resource_tracker [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating resource usage from migration b36afc8d-d0e3-4613-9dd5-227b0080649d
Nov 16 18:03:47 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:03:47 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:03:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.510s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:47 user nova-compute[75342]: INFO nova.compute.manager [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Migrating
Nov 16 18:03:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:47 user nova-compute[75342]: INFO nova.compute.rpcapi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 16 18:03:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquired lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:48 user nova-compute[75342]: DEBUG nova.network.neutron [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:03:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-fd4852fe-a1da-4632-9f0f-0b63c66c871f req-d651544f-df0d-4def-8381-f85cf04b51c8 service nova] [instance: 07c92356-fdd3-4884-b406-55c92c63db18] Received event network-vif-deleted-5d8866e3-1d92-45b7-bdb9-aa00d8a6e402 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating instance_info_cache with network_info: [{"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Releasing lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Starting migrate_disk_and_power_off {{(pid=75342) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 18:03:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:50 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance destroyed successfully.
Nov 16 18:03:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1606614034',display_name='tempest-ServerActionsTestOtherB-server-1606614034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1606614034',id=4,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1UyBGifbaRVIIusr59UKLEcXLfyd6epVSgRuItUg0lc3AijdYFqlIZoLMbi5dO5JpMBiHIhBKHMDap+u4RdhUKBD/7ZLtWgtZhiB+iJEQy+7uabGfTLiM4pLG8U3m+Tg==',key_name='tempest-keypair-290385198',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f427ee24cf34d538c1b2ae19266b9f3',ramdisk_id='',reservation_id='r-v0hi3c4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-613458522',owner_user_name='tempest-ServerActionsTestOtherB-613458522-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67704d03b80e4d709863960014fbcd24',uuid=2992b5fc-86e6-425f-82e5-cf6358582872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1537222285-network", "vif_mac": "fa:16:3e:f5:5a:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converting VIF {"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1537222285-network", "vif_mac": "fa:16:3e:f5:5a:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_vif [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2a1cbd5-36, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1135e6a-a951-4026-9642-f482a274d645) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:50 user nova-compute[75342]: INFO os_vif [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36')
Nov 16 18:03:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrZWgwTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:03:50 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa365f0-642c-4436-a557-9a130f32e964]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:03:50 user nova-compute[75342]: No targets found.
Nov 16 18:03:50 user nova-compute[75342]: iSNS:
Nov 16 18:03:50 user nova-compute[75342]: No targets found.
Nov 16 18:03:50 user nova-compute[75342]: STATIC:
Nov 16 18:03:50 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd
Nov 16 18:03:50 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:03:50 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:03:50 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:03:50 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:03:50 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:03:50 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea
Nov 16 18:03:50 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:03:50 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:03:50 user nova-compute[75342]: FIRMWARE:
Nov 16 18:03:50 user nova-compute[75342]: No targets found.
Nov 16 18:03:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:03:50 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:03:50 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6cd5c2-d5c7-4320-b8d1-b446bea28406]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b3d803-8951-462b-b591-51df51241d59]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:03:50 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:03:50 user nova-compute[75342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:03:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:03:50 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:03:50 user nova-compute[75342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:03:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4637010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc68c0b8-41f2-44af-b6d1-8eae15551470]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[205b6c39-e0fd-4a01-a31b-dd0b5898be75]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba290b3-281b-4bf6-ae5e-322c15bb2395]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97136f91-0bd0-4fc0-bee4-5c602d1dbf14]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a338a405-ec9b-4ec8-8dac-9714f107cc48]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe90bf25-3d22-431e-bcfe-ac96152fa505]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]
Nov 16 18:03:50 user nova-compute[75342]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.
Nov 16 18:03:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f93e8c-e592-4004-8e8b-78aa125c5406]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] <== disconnect_volume: return (325ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "c6408c85-ed86-4b11-afa6-14f93b92492c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:03:50 user nova-compute[75342]: INFO nova.compute.claims [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Claim successful on node user
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872_resize/disk /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "cp -r /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872_resize/disk /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk" returned: 0 in 0.481s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872_resize/disk.info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk.info {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "cp -r /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872_resize/disk.info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk.info" returned: 0 in 0.037s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:03:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:03:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG nova.policy [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '520c2ec376be46aaabcc5ca1c7aa831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c366b0f382394d26a46a902606d1b860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:03:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Creating image(s)
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "/opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "/opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.229s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.169s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk 1073741824" returned: 0 in 0.047s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Cannot resize image /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Ensure instance console log exists: /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Successfully created port: 99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Port b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf binding to destination host user is already ACTIVE {{(pid=75342) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquired lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG nova.network.neutron [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG nova.network.neutron [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating instance_info_cache with network_info: [{"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Releasing lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG os_brick.utils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71396bb-830b-42f9-9127-7961f7792b7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f27322-92f5-41ba-bac9-3d33b4926d83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[507093ed-999e-4dd3-b1ec-07ea28cb5a6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65439c4-c975-4250-b7d7-3fc5c268e966]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:03:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:03:54 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:03:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[537c2e79-e7c1-434e-bfcd-b3357595f30c]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG os_brick.utils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Successfully updated port: 99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "refresh_cache-c6408c85-ed86-4b11-afa6-14f93b92492c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquired lock "refresh_cache-c6408c85-ed86-4b11-afa6-14f93b92492c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-c31ba196-2eaf-41fb-90dd-efb19a272e76 req-b7e5d659-8663-4a62-aded-f6820a6b2284 service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Received event network-changed-99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-c31ba196-2eaf-41fb-90dd-efb19a272e76 req-b7e5d659-8663-4a62-aded-f6820a6b2284 service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Refreshing instance network info cache due to event network-changed-99579047-4ff0-4461-b833-102b0ee49c64. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c31ba196-2eaf-41fb-90dd-efb19a272e76 req-b7e5d659-8663-4a62-aded-f6820a6b2284 service nova] Acquiring lock "refresh_cache-c6408c85-ed86-4b11-afa6-14f93b92492c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:03:54 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Updating instance_info_cache with network_info: [{"id": "99579047-4ff0-4461-b833-102b0ee49c64", "address": "fa:16:3e:8d:b1:25", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99579047-4f", "ovs_interfaceid": "99579047-4ff0-4461-b833-102b0ee49c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Releasing lock "refresh_cache-c6408c85-ed86-4b11-afa6-14f93b92492c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Instance network_info: |[{"id": "99579047-4ff0-4461-b833-102b0ee49c64", "address": "fa:16:3e:8d:b1:25", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99579047-4f", "ovs_interfaceid": "99579047-4ff0-4461-b833-102b0ee49c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c31ba196-2eaf-41fb-90dd-efb19a272e76 req-b7e5d659-8663-4a62-aded-f6820a6b2284 service nova] Acquired lock "refresh_cache-c6408c85-ed86-4b11-afa6-14f93b92492c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-c31ba196-2eaf-41fb-90dd-efb19a272e76 req-b7e5d659-8663-4a62-aded-f6820a6b2284 service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Refreshing network info cache for port 99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Start _get_guest_xml network_info=[{"id": "99579047-4ff0-4461-b833-102b0ee49c64", "address": "fa:16:3e:8d:b1:25", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99579047-4f", "ovs_interfaceid": "99579047-4ff0-4461-b833-102b0ee49c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:03:55 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:03:55 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-406309213',display_name='tempest-ServersNegativeTestJSON-server-406309213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-406309213',id=18,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c366b0f382394d26a46a902606d1b860',ramdisk_id='',reservation_id='r-fgafitg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1517580992',owner_user_name='tempest-ServersNegativeTestJSON-1517580992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:52Z,user_data=None,user_id='520c2ec376be46aaabcc5ca1c7aa831c',uuid=c6408c85-ed86-4b11-afa6-14f93b92492c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99579047-4ff0-4461-b833-102b0ee49c64", "address": "fa:16:3e:8d:b1:25", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99579047-4f", "ovs_interfaceid": "99579047-4ff0-4461-b833-102b0ee49c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converting VIF {"id": "99579047-4ff0-4461-b833-102b0ee49c64", "address": "fa:16:3e:8d:b1:25", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99579047-4f", "ovs_interfaceid": "99579047-4ff0-4461-b833-102b0ee49c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b1:25,bridge_name='br-int',has_traffic_filtering=True,id=99579047-4ff0-4461-b833-102b0ee49c64,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99579047-4f') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.objects.instance [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lazy-loading 'pci_devices' on Instance uuid c6408c85-ed86-4b11-afa6-14f93b92492c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:03:55 user nova-compute[75342]:   <uuid>c6408c85-ed86-4b11-afa6-14f93b92492c</uuid>
Nov 16 18:03:55 user nova-compute[75342]:   <name>instance-00000012</name>
Nov 16 18:03:55 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:03:55 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:03:55 user nova-compute[75342]:   <metadata>
Nov 16 18:03:55 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:03:55 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:03:55 user nova-compute[75342]:       <nova:name>tempest-ServersNegativeTestJSON-server-406309213</nova:name>
Nov 16 18:03:55 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:03:55</nova:creationTime>
Nov 16 18:03:55 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:03:55 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:03:55 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:03:55 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:03:55 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:03:55 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:03:55 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:03:55 user nova-compute[75342]:       <nova:owner>
Nov 16 18:03:55 user nova-compute[75342]:         <nova:user uuid="520c2ec376be46aaabcc5ca1c7aa831c">tempest-ServersNegativeTestJSON-1517580992-project-member</nova:user>
Nov 16 18:03:55 user nova-compute[75342]:         <nova:project uuid="c366b0f382394d26a46a902606d1b860">tempest-ServersNegativeTestJSON-1517580992</nova:project>
Nov 16 18:03:55 user nova-compute[75342]:       </nova:owner>
Nov 16 18:03:55 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:03:55 user nova-compute[75342]:       <nova:ports>
Nov 16 18:03:55 user nova-compute[75342]:         <nova:port uuid="99579047-4ff0-4461-b833-102b0ee49c64">
Nov 16 18:03:55 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 18:03:55 user nova-compute[75342]:         </nova:port>
Nov 16 18:03:55 user nova-compute[75342]:       </nova:ports>
Nov 16 18:03:55 user nova-compute[75342]:     </nova:instance>
Nov 16 18:03:55 user nova-compute[75342]:   </metadata>
Nov 16 18:03:55 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:03:55 user nova-compute[75342]:     <system>
Nov 16 18:03:55 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:03:55 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:03:55 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:03:55 user nova-compute[75342]:       <entry name="serial">c6408c85-ed86-4b11-afa6-14f93b92492c</entry>
Nov 16 18:03:55 user nova-compute[75342]:       <entry name="uuid">c6408c85-ed86-4b11-afa6-14f93b92492c</entry>
Nov 16 18:03:55 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:03:55 user nova-compute[75342]:     </system>
Nov 16 18:03:55 user nova-compute[75342]:   </sysinfo>
Nov 16 18:03:55 user nova-compute[75342]:   <os>
Nov 16 18:03:55 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:03:55 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:03:55 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:03:55 user nova-compute[75342]:   </os>
Nov 16 18:03:55 user nova-compute[75342]:   <features>
Nov 16 18:03:55 user nova-compute[75342]:     <acpi/>
Nov 16 18:03:55 user nova-compute[75342]:     <apic/>
Nov 16 18:03:55 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:03:55 user nova-compute[75342]:   </features>
Nov 16 18:03:55 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:03:55 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:03:55 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:03:55 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:03:55 user nova-compute[75342]:   </clock>
Nov 16 18:03:55 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:03:55 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:03:55 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:03:55 user nova-compute[75342]:   </cpu>
Nov 16 18:03:55 user nova-compute[75342]:   <devices>
Nov 16 18:03:55 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:03:55 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:03:55 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk"/>
Nov 16 18:03:55 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:03:55 user nova-compute[75342]:     </disk>
Nov 16 18:03:55 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:03:55 user nova-compute[75342]:       <mac address="fa:16:3e:8d:b1:25"/>
Nov 16 18:03:55 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:03:55 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:03:55 user nova-compute[75342]:       <target dev="tap99579047-4f"/>
Nov 16 18:03:55 user nova-compute[75342]:     </interface>
Nov 16 18:03:55 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:03:55 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/console.log" append="off"/>
Nov 16 18:03:55 user nova-compute[75342]:     </serial>
Nov 16 18:03:55 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:03:55 user nova-compute[75342]:     <video>
Nov 16 18:03:55 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:03:55 user nova-compute[75342]:     </video>
Nov 16 18:03:55 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:03:55 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:03:55 user nova-compute[75342]:     </rng>
Nov 16 18:03:55 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:03:55 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:03:55 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:03:55 user nova-compute[75342]:     </memballoon>
Nov 16 18:03:55 user nova-compute[75342]:   </devices>
Nov 16 18:03:55 user nova-compute[75342]: </domain>
Nov 16 18:03:55 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-406309213',display_name='tempest-ServersNegativeTestJSON-server-406309213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-406309213',id=18,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c366b0f382394d26a46a902606d1b860',ramdisk_id='',reservation_id='r-fgafitg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1517580992',owner_user_name='tempest-ServersNegativeTestJSON-1517580992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:52Z,user_data=None,user_id='520c2ec376be46aaabcc5ca1c7aa831c',uuid=c6408c85-ed86-4b11-afa6-14f93b92492c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99579047-4ff0-4461-b833-102b0ee49c64", "address": "fa:16:3e:8d:b1:25", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99579047-4f", "ovs_interfaceid": "99579047-4ff0-4461-b833-102b0ee49c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converting VIF {"id": "99579047-4ff0-4461-b833-102b0ee49c64", "address": "fa:16:3e:8d:b1:25", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99579047-4f", "ovs_interfaceid": "99579047-4ff0-4461-b833-102b0ee49c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b1:25,bridge_name='br-int',has_traffic_filtering=True,id=99579047-4ff0-4461-b833-102b0ee49c64,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99579047-4f') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG os_vif [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b1:25,bridge_name='br-int',has_traffic_filtering=True,id=99579047-4ff0-4461-b833-102b0ee49c64,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99579047-4f') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01c4a55e-8da4-5f85-bd1c-daacefe6b8d1', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99579047-4f, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99579047-4f, col_values=(('qos', UUID('90207da5-5e69-4369-aa0a-74a07a94fb94')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99579047-4f, col_values=(('external_ids', {'iface-id': '99579047-4ff0-4461-b833-102b0ee49c64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:b1:25', 'vm-uuid': 'c6408c85-ed86-4b11-afa6-14f93b92492c'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:55 user nova-compute[75342]: INFO os_vif [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b1:25,bridge_name='br-int',has_traffic_filtering=True,id=99579047-4ff0-4461-b833-102b0ee49c64,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99579047-4f')
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:03:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] No VIF found with MAC fa:16:3e:8d:b1:25, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-c31ba196-2eaf-41fb-90dd-efb19a272e76 req-b7e5d659-8663-4a62-aded-f6820a6b2284 service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Updated VIF entry in instance network info cache for port 99579047-4ff0-4461-b833-102b0ee49c64. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-c31ba196-2eaf-41fb-90dd-efb19a272e76 req-b7e5d659-8663-4a62-aded-f6820a6b2284 service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Updating instance_info_cache with network_info: [{"id": "99579047-4ff0-4461-b833-102b0ee49c64", "address": "fa:16:3e:8d:b1:25", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99579047-4f", "ovs_interfaceid": "99579047-4ff0-4461-b833-102b0ee49c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c31ba196-2eaf-41fb-90dd-efb19a272e76 req-b7e5d659-8663-4a62-aded-f6820a6b2284 service nova] Releasing lock "refresh_cache-c6408c85-ed86-4b11-afa6-14f93b92492c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-unplugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-unplugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:56 user nova-compute[75342]: WARNING nova.compute.manager [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received unexpected event network-vif-unplugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with vm_state active and task_state resize_finish.
Nov 16 18:03:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:56 user nova-compute[75342]: WARNING nova.compute.manager [req-ab2e0b50-1a44-4947-980c-1955acb946e9 req-0719f777-35b6-413c-a1c1-6f9e25977fbf service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received unexpected event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with vm_state active and task_state resize_finish.
Nov 16 18:03:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:57 user nova-compute[75342]: INFO nova.compute.manager [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Terminating instance
Nov 16 18:03:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:58 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Instance destroyed successfully.
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.objects.instance [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lazy-loading 'resources' on Instance uuid a04eb165-88b6-4826-a4ac-c1bc51a57ba5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1210781846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1419826400',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2YBWpL94rC07MMzLKaBsNk11Qeq2JUeq4m7GthUjfbOD5heJ9mYXBMqIg2uamJMvflvGY3eC+tTt19WLMkmpw0VhnB/T+nyASoArfoa2sGiszErzJ01aVT1fJwxYOKpw==',key_name='tempest-keypair-690867906',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:02:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fea851a0954345a0b6a29f5fa178f476',ramdisk_id='',reservation_id='r-utzjni68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-439717470',owner_user_name='tempest-ServerActionsV293TestJSON-439717470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca2efbe29024457cb872f32e561f0a21',uuid=a04eb165-88b6-4826-a4ac-c1bc51a57ba5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converting VIF {"id": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "address": "fa:16:3e:ff:fd:18", "network": {"id": "23a5f411-e2bb-443b-b743-ca16bbfbe7e9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1927757411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea851a0954345a0b6a29f5fa178f476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e051e5-17", "ovs_interfaceid": "90e051e5-17e8-4b97-92c4-2bd190722aa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_vif [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90e051e5-17, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b05ee02-9c75-45c0-90b2-f1795cd1e888) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:03:58 user nova-compute[75342]: INFO os_vif [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:fd:18,bridge_name='br-int',has_traffic_filtering=True,id=90e051e5-17e8-4b97-92c4-2bd190722aa7,network=Network(23a5f411-e2bb-443b-b743-ca16bbfbe7e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e051e5-17')
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWYftGCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:03:58 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88ddc31-aacd-42d7-8fe5-a68d60c2b3ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:03:58 user nova-compute[75342]: No targets found.
Nov 16 18:03:58 user nova-compute[75342]: iSNS:
Nov 16 18:03:58 user nova-compute[75342]: No targets found.
Nov 16 18:03:58 user nova-compute[75342]: STATIC:
Nov 16 18:03:58 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:03:58 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:03:58 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:03:58 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea
Nov 16 18:03:58 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:03:58 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:03:58 user nova-compute[75342]: FIRMWARE:
Nov 16 18:03:58 user nova-compute[75342]: No targets found.
Nov 16 18:03:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:03:58 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:03:58 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e21d41-129b-4f72-a680-b77670b0d4f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c21c079-d7ed-416a-84b7-645af7594b1d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:03:58 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:03:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea (non-flash)
Nov 16 18:03:58 user nova-compute[75342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:03:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c8188d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea'): ({'sdc'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Removing single pathed devices sdc {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bf10cd-b931-4f6b-8006-f4ccbc76c7fe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[866748af-5897-4d20-958b-1b7c8ef1268d]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Flushing IO for device /dev/sdc {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad59e6f2-e79d-4ae2-be55-ab39daddb2ba]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f19574a-07a1-420e-8b91-ee09bf091e66]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26663653135633035', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f24bc77e', '/dev/disk/by-id/scsi-1SCST_BIOf24bc77e-fce15c050c82ff43') {{(pid=85570) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5e6f9e-354e-428c-b9e8-2dde1c2846c9]: (4, None) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b38d6-b3fd-4cde-9979-d2232394f45f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[778dd781-426d-4256-b940-b569f7f6dd8f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260]
Nov 16 18:03:58 user nova-compute[75342]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea, portal: 172.16.0.220,3260] successful.
Nov 16 18:03:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e99588c0-6d23-4cdf-b077-4d9d23522cea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7a71ed-0f0a-4910-8360-87506aaf5e12]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] <== disconnect_volume: return (354ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:03:58 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Deleting instance files /opt/stack/data/nova/instances/a04eb165-88b6-4826-a4ac-c1bc51a57ba5_del
Nov 16 18:03:58 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Deletion of /opt/stack/data/nova/instances/a04eb165-88b6-4826-a4ac-c1bc51a57ba5_del complete
Nov 16 18:03:58 user nova-compute[75342]: INFO nova.compute.manager [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Received event network-vif-plugged-99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] Acquiring lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] No waiting events found dispatching network-vif-plugged-99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:58 user nova-compute[75342]: WARNING nova.compute.manager [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Received unexpected event network-vif-plugged-99579047-4ff0-4461-b833-102b0ee49c64 for instance with vm_state building and task_state spawning.
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Received event network-vif-plugged-99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] Acquiring lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] No waiting events found dispatching network-vif-plugged-99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:03:58 user nova-compute[75342]: WARNING nova.compute.manager [req-d6425aa1-088e-4a2b-baa2-d0ffc2085fad req-f5078ee8-6be8-465a-a483-33f057957a9f service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Received unexpected event network-vif-plugged-99579047-4ff0-4461-b833-102b0ee49c64 for instance with vm_state building and task_state spawning.
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:03:58 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Instance spawned successfully.
Nov 16 18:03:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:03:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:03:59 user nova-compute[75342]: INFO nova.compute.manager [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Took 7.42 seconds to spawn the instance on the hypervisor.
Nov 16 18:03:59 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:03:59 user nova-compute[75342]: INFO nova.compute.manager [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Took 8.39 seconds to build instance.
Nov 16 18:03:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e481c502-fa05-4ed1-a804-3b6651be5880 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.500s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:03:59 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:03:59 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Took 0.86 seconds to deallocate network for instance.
Nov 16 18:03:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Starting finish_migration {{(pid=75342) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 18:03:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance directory exists: not creating {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 18:03:59 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Creating image(s)
Nov 16 18:03:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:03:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:03:59 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk. size=21474836480 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:03:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk 21474836480 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk 21474836480" returned: 0 in 0.144s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Ensure instance console log exists: /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Start _get_guest_xml network_info=[{"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1537222285-network", "vif_mac": "fa:16:3e:f5:5a:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'af3a86b2-4407-48de-8fda-6c9ff01c762c', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrZWgwTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2992b5fc-86e6-425f-82e5-cf6358582872', 'attached_at': '2023-11-16T18:04:00.000000', 'detached_at': '', 'volume_id': 'a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'serial': 'a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:04:00 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:00 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrZWgwTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:04:00 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:04:00 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:04:00 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8de5e3-4476-460b-9045-8ae7f585e708]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:04:00 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: INFO nova.compute.manager [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Took 1.06 seconds to detach 1 volumes for instance.
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Deleting volume: e99588c0-6d23-4cdf-b077-4d9d23522cea {{(pid=75342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[299446e5-b67d-4612-9467-2941c125d64d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd] added
Nov 16 18:04:00 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[516a89c6-789c-4583-866c-745f79570a9b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35058cb-a3d7-49ef-941e-68c0ae554ee6]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrZWgwTd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrZWgwTd" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb4d236-a748-4032-8ec4-114f8b529c1a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UrZWgwTd'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d8fb89-305f-4814-83fa-e14f7e669586]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d66587-93a1-422e-b5d4-0e89881644bb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:04:00 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:04:00 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba83e9a-0e3b-4356-9c5b-90db7688bc7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]
Nov 16 18:04:00 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.
Nov 16 18:04:00 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b86c73-9ba5-4418-9144-17fe1b4fac0c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdaa661-1c2d-47d2-b30f-b446514d94cf]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:04:00 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:04:00 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:04:00 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:04:00 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a679e8-685a-4f2b-8a89-1ea6b9853cf6]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrZWgwTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-ff3a194c-b821-4c31-9f1a-6489aabca62a req-ba964def-dc02-4097-a877-3cb627ecb26d service nova] [instance: a04eb165-88b6-4826-a4ac-c1bc51a57ba5] Received event network-vif-deleted-90e051e5-17e8-4b97-92c4-2bd190722aa7 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.191s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:04:01 user nova-compute[75342]: INFO nova.compute.claims [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Claim successful on node user
Nov 16 18:04:01 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Deleted allocations for instance a04eb165-88b6-4826-a4ac-c1bc51a57ba5
Nov 16 18:04:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d9c2a653-5b5c-4baf-bf8a-31a33d8d45ea tempest-ServerActionsV293TestJSON-439717470 tempest-ServerActionsV293TestJSON-439717470-project-member] Lock "a04eb165-88b6-4826-a4ac-c1bc51a57ba5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.220s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23130356636653034', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130356636653034', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.network.neutron [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1606614034',display_name='tempest-ServerActionsTestOtherB-server-1606614034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1606614034',id=4,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1UyBGifbaRVIIusr59UKLEcXLfyd6epVSgRuItUg0lc3AijdYFqlIZoLMbi5dO5JpMBiHIhBKHMDap+u4RdhUKBD/7ZLtWgtZhiB+iJEQy+7uabGfTLiM4pLG8U3m+Tg==',key_name='tempest-keypair-290385198',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f427ee24cf34d538c1b2ae19266b9f3',ramdisk_id='',reservation_id='r-v0hi3c4d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-613458522',owner_user_name='tempest-ServerActionsTestOtherB-613458522-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67704d03b80e4d709863960014fbcd24',uuid=2992b5fc-86e6-425f-82e5-cf6358582872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1537222285-network", "vif_mac": "fa:16:3e:f5:5a:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converting VIF {"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1537222285-network", "vif_mac": "fa:16:3e:f5:5a:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:04:01 user nova-compute[75342]:   <uuid>2992b5fc-86e6-425f-82e5-cf6358582872</uuid>
Nov 16 18:04:01 user nova-compute[75342]:   <name>instance-00000004</name>
Nov 16 18:04:01 user nova-compute[75342]:   <memory>2097152</memory>
Nov 16 18:04:01 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:04:01 user nova-compute[75342]:   <metadata>
Nov 16 18:04:01 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:04:01 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:04:01 user nova-compute[75342]:       <nova:name>tempest-ServerActionsTestOtherB-server-1606614034</nova:name>
Nov 16 18:04:01 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:04:00</nova:creationTime>
Nov 16 18:04:01 user nova-compute[75342]:       <nova:flavor name="m1.small">
Nov 16 18:04:01 user nova-compute[75342]:         <nova:memory>2048</nova:memory>
Nov 16 18:04:01 user nova-compute[75342]:         <nova:disk>20</nova:disk>
Nov 16 18:04:01 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:04:01 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:04:01 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:04:01 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:04:01 user nova-compute[75342]:       <nova:owner>
Nov 16 18:04:01 user nova-compute[75342]:         <nova:user uuid="67704d03b80e4d709863960014fbcd24">tempest-ServerActionsTestOtherB-613458522-project-member</nova:user>
Nov 16 18:04:01 user nova-compute[75342]:         <nova:project uuid="2f427ee24cf34d538c1b2ae19266b9f3">tempest-ServerActionsTestOtherB-613458522</nova:project>
Nov 16 18:04:01 user nova-compute[75342]:       </nova:owner>
Nov 16 18:04:01 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:04:01 user nova-compute[75342]:       <nova:ports>
Nov 16 18:04:01 user nova-compute[75342]:         <nova:port uuid="b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf">
Nov 16 18:04:01 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 18:04:01 user nova-compute[75342]:         </nova:port>
Nov 16 18:04:01 user nova-compute[75342]:       </nova:ports>
Nov 16 18:04:01 user nova-compute[75342]:     </nova:instance>
Nov 16 18:04:01 user nova-compute[75342]:   </metadata>
Nov 16 18:04:01 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:04:01 user nova-compute[75342]:     <system>
Nov 16 18:04:01 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:04:01 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:04:01 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:04:01 user nova-compute[75342]:       <entry name="serial">2992b5fc-86e6-425f-82e5-cf6358582872</entry>
Nov 16 18:04:01 user nova-compute[75342]:       <entry name="uuid">2992b5fc-86e6-425f-82e5-cf6358582872</entry>
Nov 16 18:04:01 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:04:01 user nova-compute[75342]:     </system>
Nov 16 18:04:01 user nova-compute[75342]:   </sysinfo>
Nov 16 18:04:01 user nova-compute[75342]:   <os>
Nov 16 18:04:01 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:04:01 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:04:01 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:04:01 user nova-compute[75342]:   </os>
Nov 16 18:04:01 user nova-compute[75342]:   <features>
Nov 16 18:04:01 user nova-compute[75342]:     <acpi/>
Nov 16 18:04:01 user nova-compute[75342]:     <apic/>
Nov 16 18:04:01 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:04:01 user nova-compute[75342]:   </features>
Nov 16 18:04:01 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:04:01 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:04:01 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:04:01 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:04:01 user nova-compute[75342]:   </clock>
Nov 16 18:04:01 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:04:01 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:04:01 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:04:01 user nova-compute[75342]:   </cpu>
Nov 16 18:04:01 user nova-compute[75342]:   <devices>
Nov 16 18:04:01 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:04:01 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:04:01 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk"/>
Nov 16 18:04:01 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:04:01 user nova-compute[75342]:     </disk>
Nov 16 18:04:01 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:04:01 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:04:01 user nova-compute[75342]:       <source dev="/dev/sdb"/>
Nov 16 18:04:01 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:04:01 user nova-compute[75342]:       <serial>a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd</serial>
Nov 16 18:04:01 user nova-compute[75342]:     </disk>
Nov 16 18:04:01 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:04:01 user nova-compute[75342]:       <mac address="fa:16:3e:f5:5a:de"/>
Nov 16 18:04:01 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:04:01 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:04:01 user nova-compute[75342]:       <target dev="tapb2a1cbd5-36"/>
Nov 16 18:04:01 user nova-compute[75342]:     </interface>
Nov 16 18:04:01 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:04:01 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/console.log" append="off"/>
Nov 16 18:04:01 user nova-compute[75342]:     </serial>
Nov 16 18:04:01 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:04:01 user nova-compute[75342]:     <video>
Nov 16 18:04:01 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:04:01 user nova-compute[75342]:     </video>
Nov 16 18:04:01 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:04:01 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:04:01 user nova-compute[75342]:     </rng>
Nov 16 18:04:01 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:04:01 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:04:01 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:04:01 user nova-compute[75342]:     </memballoon>
Nov 16 18:04:01 user nova-compute[75342]:   </devices>
Nov 16 18:04:01 user nova-compute[75342]: </domain>
Nov 16 18:04:01 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1606614034',display_name='tempest-ServerActionsTestOtherB-server-1606614034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1606614034',id=4,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1UyBGifbaRVIIusr59UKLEcXLfyd6epVSgRuItUg0lc3AijdYFqlIZoLMbi5dO5JpMBiHIhBKHMDap+u4RdhUKBD/7ZLtWgtZhiB+iJEQy+7uabGfTLiM4pLG8U3m+Tg==',key_name='tempest-keypair-290385198',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f427ee24cf34d538c1b2ae19266b9f3',ramdisk_id='',reservation_id='r-v0hi3c4d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-613458522',owner_user_name='tempest-ServerActionsTestOtherB-613458522-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67704d03b80e4d709863960014fbcd24',uuid=2992b5fc-86e6-425f-82e5-cf6358582872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1537222285-network", "vif_mac": "fa:16:3e:f5:5a:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converting VIF {"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1537222285-network", "vif_mac": "fa:16:3e:f5:5a:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG os_vif [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:04:01 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1a2f0a8-4f6c-5c3f-91bf-257adf98a023', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2a1cbd5-36, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2a1cbd5-36, col_values=(('qos', UUID('a0cf1f0a-53c9-4ca8-8638-569df60a6b65')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2a1cbd5-36, col_values=(('external_ids', {'iface-id': 'b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:5a:de', 'vm-uuid': '2992b5fc-86e6-425f-82e5-cf6358582872'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:04:01 user nova-compute[75342]: INFO os_vif [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36')
Nov 16 18:04:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] No VIF found with MAC fa:16:3e:f5:5a:de, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG nova.policy [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5976cde7fade404fac5146e3952cc95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b314838880c4cf68c74b2a215fa0a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:04:02 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Creating image(s)
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "/opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "/opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.239s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.227s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk 1073741824" returned: 0 in 0.065s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.203s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:03 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Cannot resize image /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:04:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:04:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Ensure instance console log exists: /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:04:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Successfully created port: 70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:04:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-a66372ff-fc80-4823-ab61-3d44ea4bdf51 req-1c2fede3-9ede-4841-bca6-ebc046799ecf service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a66372ff-fc80-4823-ab61-3d44ea4bdf51 req-1c2fede3-9ede-4841-bca6-ebc046799ecf service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a66372ff-fc80-4823-ab61-3d44ea4bdf51 req-1c2fede3-9ede-4841-bca6-ebc046799ecf service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a66372ff-fc80-4823-ab61-3d44ea4bdf51 req-1c2fede3-9ede-4841-bca6-ebc046799ecf service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-a66372ff-fc80-4823-ab61-3d44ea4bdf51 req-1c2fede3-9ede-4841-bca6-ebc046799ecf service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:04 user nova-compute[75342]: WARNING nova.compute.manager [req-a66372ff-fc80-4823-ab61-3d44ea4bdf51 req-1c2fede3-9ede-4841-bca6-ebc046799ecf service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received unexpected event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with vm_state active and task_state resize_finish.
Nov 16 18:04:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG nova.network.neutron [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Successfully updated port: 70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquired lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:04:04 user nova-compute[75342]: DEBUG nova.network.neutron [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updating instance_info_cache with network_info: [{"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Releasing lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Instance network_info: |[{"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Start _get_guest_xml network_info=[{"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539067305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539067305',id=19,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQOSo7uIdt9k/PLg6VsDFmL+PRo3dwsxAbcVSW3Wj40XjIJQYbNLBtz/3H+zlgRaTYbZ1HgboxKf6Gyi0Z2bFK+BAiKEPzbjUjlAGPu0n8gqG1SnPKxOjVIlr4Yh7ayVQ==',key_name='tempest-keypair-279505456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-4tz76pmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=fb00d09d-d7c3-43f8-a118-26868011460b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.objects.instance [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'pci_devices' on Instance uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:04:05 user nova-compute[75342]:   <uuid>fb00d09d-d7c3-43f8-a118-26868011460b</uuid>
Nov 16 18:04:05 user nova-compute[75342]:   <name>instance-00000013</name>
Nov 16 18:04:05 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:04:05 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:04:05 user nova-compute[75342]:   <metadata>
Nov 16 18:04:05 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:04:05 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:04:05 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-539067305</nova:name>
Nov 16 18:04:05 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:04:05</nova:creationTime>
Nov 16 18:04:05 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:04:05 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:04:05 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:04:05 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:04:05 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:04:05 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:04:05 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:04:05 user nova-compute[75342]:       <nova:owner>
Nov 16 18:04:05 user nova-compute[75342]:         <nova:user uuid="5976cde7fade404fac5146e3952cc95f">tempest-AttachVolumeShelveTestJSON-1298817282-project-member</nova:user>
Nov 16 18:04:05 user nova-compute[75342]:         <nova:project uuid="2b314838880c4cf68c74b2a215fa0a78">tempest-AttachVolumeShelveTestJSON-1298817282</nova:project>
Nov 16 18:04:05 user nova-compute[75342]:       </nova:owner>
Nov 16 18:04:05 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:04:05 user nova-compute[75342]:       <nova:ports>
Nov 16 18:04:05 user nova-compute[75342]:         <nova:port uuid="70d27952-7221-44f5-b6fb-24d3416b1b2e">
Nov 16 18:04:05 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 18:04:05 user nova-compute[75342]:         </nova:port>
Nov 16 18:04:05 user nova-compute[75342]:       </nova:ports>
Nov 16 18:04:05 user nova-compute[75342]:     </nova:instance>
Nov 16 18:04:05 user nova-compute[75342]:   </metadata>
Nov 16 18:04:05 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:04:05 user nova-compute[75342]:     <system>
Nov 16 18:04:05 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:04:05 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:04:05 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:04:05 user nova-compute[75342]:       <entry name="serial">fb00d09d-d7c3-43f8-a118-26868011460b</entry>
Nov 16 18:04:05 user nova-compute[75342]:       <entry name="uuid">fb00d09d-d7c3-43f8-a118-26868011460b</entry>
Nov 16 18:04:05 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:04:05 user nova-compute[75342]:     </system>
Nov 16 18:04:05 user nova-compute[75342]:   </sysinfo>
Nov 16 18:04:05 user nova-compute[75342]:   <os>
Nov 16 18:04:05 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:04:05 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:04:05 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:04:05 user nova-compute[75342]:   </os>
Nov 16 18:04:05 user nova-compute[75342]:   <features>
Nov 16 18:04:05 user nova-compute[75342]:     <acpi/>
Nov 16 18:04:05 user nova-compute[75342]:     <apic/>
Nov 16 18:04:05 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:04:05 user nova-compute[75342]:   </features>
Nov 16 18:04:05 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:04:05 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:04:05 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:04:05 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:04:05 user nova-compute[75342]:   </clock>
Nov 16 18:04:05 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:04:05 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:04:05 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:04:05 user nova-compute[75342]:   </cpu>
Nov 16 18:04:05 user nova-compute[75342]:   <devices>
Nov 16 18:04:05 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:04:05 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:04:05 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk"/>
Nov 16 18:04:05 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:04:05 user nova-compute[75342]:     </disk>
Nov 16 18:04:05 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:04:05 user nova-compute[75342]:       <mac address="fa:16:3e:c5:bd:3a"/>
Nov 16 18:04:05 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:04:05 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:04:05 user nova-compute[75342]:       <target dev="tap70d27952-72"/>
Nov 16 18:04:05 user nova-compute[75342]:     </interface>
Nov 16 18:04:05 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:04:05 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/console.log" append="off"/>
Nov 16 18:04:05 user nova-compute[75342]:     </serial>
Nov 16 18:04:05 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:04:05 user nova-compute[75342]:     <video>
Nov 16 18:04:05 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:04:05 user nova-compute[75342]:     </video>
Nov 16 18:04:05 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:04:05 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:04:05 user nova-compute[75342]:     </rng>
Nov 16 18:04:05 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:04:05 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:04:05 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:04:05 user nova-compute[75342]:     </memballoon>
Nov 16 18:04:05 user nova-compute[75342]:   </devices>
Nov 16 18:04:05 user nova-compute[75342]: </domain>
Nov 16 18:04:05 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539067305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539067305',id=19,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQOSo7uIdt9k/PLg6VsDFmL+PRo3dwsxAbcVSW3Wj40XjIJQYbNLBtz/3H+zlgRaTYbZ1HgboxKf6Gyi0Z2bFK+BAiKEPzbjUjlAGPu0n8gqG1SnPKxOjVIlr4Yh7ayVQ==',key_name='tempest-keypair-279505456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-4tz76pmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=fb00d09d-d7c3-43f8-a118-26868011460b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG os_vif [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '866db88f-72db-5b73-8660-f59504245c58', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70d27952-72, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70d27952-72, col_values=(('qos', UUID('882084e2-5c24-4b6e-a99c-ff3da79384f3')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70d27952-72, col_values=(('external_ids', {'iface-id': '70d27952-7221-44f5-b6fb-24d3416b1b2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:bd:3a', 'vm-uuid': 'fb00d09d-d7c3-43f8-a118-26868011460b'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:05 user nova-compute[75342]: INFO os_vif [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72')
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:04:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] No VIF found with MAC fa:16:3e:c5:bd:3a, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:06 user nova-compute[75342]: WARNING nova.compute.manager [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received unexpected event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with vm_state active and task_state resize_finish.
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-changed-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Refreshing instance network info cache due to event network-changed-70d27952-7221-44f5-b6fb-24d3416b1b2e. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] Acquiring lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] Acquired lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Refreshing network info cache for port 70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:04:06 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance running successfully.
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Failed to set time: agent not configured {{(pid=75342) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-375fc96e-880c-464a-8432-58e01f27295c tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] finish_migration finished successfully. {{(pid=75342) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Acquiring lock "8b5474bd-3446-452a-adb4-63138de26b3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "8b5474bd-3446-452a-adb4-63138de26b3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updated VIF entry in instance network info cache for port 70d27952-7221-44f5-b6fb-24d3416b1b2e. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updating instance_info_cache with network_info: [{"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-337f666a-3085-4371-8bdf-9a6b8fa90f6c req-0664a435-58a2-46e7-a82b-f267b8412c49 service nova] Releasing lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:06 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:04:06 user nova-compute[75342]: INFO nova.compute.claims [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Claim successful on node user
Nov 16 18:04:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-bd70eefc-a464-4058-8796-b118e97d11d4 req-3bdbc04b-37a3-4058-becc-fb63fc2e185b service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-bd70eefc-a464-4058-8796-b118e97d11d4 req-3bdbc04b-37a3-4058-becc-fb63fc2e185b service nova] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-bd70eefc-a464-4058-8796-b118e97d11d4 req-3bdbc04b-37a3-4058-becc-fb63fc2e185b service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-bd70eefc-a464-4058-8796-b118e97d11d4 req-3bdbc04b-37a3-4058-becc-fb63fc2e185b service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-bd70eefc-a464-4058-8796-b118e97d11d4 req-3bdbc04b-37a3-4058-becc-fb63fc2e185b service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] No waiting events found dispatching network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:07 user nova-compute[75342]: WARNING nova.compute.manager [req-bd70eefc-a464-4058-8796-b118e97d11d4 req-3bdbc04b-37a3-4058-becc-fb63fc2e185b service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received unexpected event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e for instance with vm_state building and task_state spawning.
Nov 16 18:04:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.705s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG nova.network.neutron [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:04:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:04:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG nova.policy [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0e629a008074df3a1ae71096540d77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6892c1b7794d41a275f70883125d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:04:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Creating image(s)
Nov 16 18:04:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "/opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "/opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.195s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.227s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk 1073741824" returned: 0 in 0.049s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.205s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG nova.network.neutron [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Successfully created port: b89571ae-400a-4458-a0f9-3f7ab07b2ca0 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Cannot resize image /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Ensure instance console log exists: /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.network.neutron [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Successfully updated port: b89571ae-400a-4458-a0f9-3f7ab07b2ca0 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Acquiring lock "refresh_cache-8b5474bd-3446-452a-adb4-63138de26b3d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Acquired lock "refresh_cache-8b5474bd-3446-452a-adb4-63138de26b3d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.network.neutron [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-96680a33-dffd-46da-aa8b-a2b25b41d59b req-4b4e5887-11e6-456e-aa1b-c385ed30c6c1 service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Received event network-changed-b89571ae-400a-4458-a0f9-3f7ab07b2ca0 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-96680a33-dffd-46da-aa8b-a2b25b41d59b req-4b4e5887-11e6-456e-aa1b-c385ed30c6c1 service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Refreshing instance network info cache due to event network-changed-b89571ae-400a-4458-a0f9-3f7ab07b2ca0. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-96680a33-dffd-46da-aa8b-a2b25b41d59b req-4b4e5887-11e6-456e-aa1b-c385ed30c6c1 service nova] Acquiring lock "refresh_cache-8b5474bd-3446-452a-adb4-63138de26b3d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.network.neutron [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-f69df2b2-21c2-434e-8430-4a0749f2035c req-94fd720d-ce39-451f-b149-3929b951809f service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f69df2b2-21c2-434e-8430-4a0749f2035c req-94fd720d-ce39-451f-b149-3929b951809f service nova] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f69df2b2-21c2-434e-8430-4a0749f2035c req-94fd720d-ce39-451f-b149-3929b951809f service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f69df2b2-21c2-434e-8430-4a0749f2035c req-94fd720d-ce39-451f-b149-3929b951809f service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-f69df2b2-21c2-434e-8430-4a0749f2035c req-94fd720d-ce39-451f-b149-3929b951809f service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] No waiting events found dispatching network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:09 user nova-compute[75342]: WARNING nova.compute.manager [req-f69df2b2-21c2-434e-8430-4a0749f2035c req-94fd720d-ce39-451f-b149-3929b951809f service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received unexpected event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e for instance with vm_state building and task_state spawning.
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.compute.manager [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:04:09 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Instance spawned successfully.
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.network.neutron [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Updating instance_info_cache with network_info: [{"id": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "address": "fa:16:3e:a3:05:62", "network": {"id": "b2a9154b-3516-4b0d-81bf-834846aafa8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450872312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6892c1b7794d41a275f70883125d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89571ae-40", "ovs_interfaceid": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Releasing lock "refresh_cache-8b5474bd-3446-452a-adb4-63138de26b3d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.compute.manager [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Instance network_info: |[{"id": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "address": "fa:16:3e:a3:05:62", "network": {"id": "b2a9154b-3516-4b0d-81bf-834846aafa8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450872312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6892c1b7794d41a275f70883125d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89571ae-40", "ovs_interfaceid": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-96680a33-dffd-46da-aa8b-a2b25b41d59b req-4b4e5887-11e6-456e-aa1b-c385ed30c6c1 service nova] Acquired lock "refresh_cache-8b5474bd-3446-452a-adb4-63138de26b3d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-96680a33-dffd-46da-aa8b-a2b25b41d59b req-4b4e5887-11e6-456e-aa1b-c385ed30c6c1 service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Refreshing network info cache for port b89571ae-400a-4458-a0f9-3f7ab07b2ca0 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Start _get_guest_xml network_info=[{"id": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "address": "fa:16:3e:a3:05:62", "network": {"id": "b2a9154b-3516-4b0d-81bf-834846aafa8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450872312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6892c1b7794d41a275f70883125d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89571ae-40", "ovs_interfaceid": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:04:09 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:09 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:04:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-955240700',display_name='tempest-VolumesActionsTest-instance-955240700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-955240700',id=20,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6892c1b7794d41a275f70883125d11',ramdisk_id='',reservation_id='r-rc26wq6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-528330809',owner_user_name='tempest-VolumesActionsTest-528330809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:04:08Z,user_data=None,user_id='c0e629a008074df3a1ae71096540d77c',uuid=8b5474bd-3446-452a-adb4-63138de26b3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "address": "fa:16:3e:a3:05:62", "network": {"id": "b2a9154b-3516-4b0d-81bf-834846aafa8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450872312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6892c1b7794d41a275f70883125d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89571ae-40", "ovs_interfaceid": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Converting VIF {"id": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "address": "fa:16:3e:a3:05:62", "network": {"id": "b2a9154b-3516-4b0d-81bf-834846aafa8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450872312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6892c1b7794d41a275f70883125d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89571ae-40", "ovs_interfaceid": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:62,bridge_name='br-int',has_traffic_filtering=True,id=b89571ae-400a-4458-a0f9-3f7ab07b2ca0,network=Network(b2a9154b-3516-4b0d-81bf-834846aafa8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89571ae-40') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.objects.instance [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b5474bd-3446-452a-adb4-63138de26b3d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:04:10 user nova-compute[75342]:   <uuid>8b5474bd-3446-452a-adb4-63138de26b3d</uuid>
Nov 16 18:04:10 user nova-compute[75342]:   <name>instance-00000014</name>
Nov 16 18:04:10 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:04:10 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:04:10 user nova-compute[75342]:   <metadata>
Nov 16 18:04:10 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:04:10 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:04:10 user nova-compute[75342]:       <nova:name>tempest-VolumesActionsTest-instance-955240700</nova:name>
Nov 16 18:04:10 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:04:09</nova:creationTime>
Nov 16 18:04:10 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:04:10 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:04:10 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:04:10 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:04:10 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:04:10 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:04:10 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:04:10 user nova-compute[75342]:       <nova:owner>
Nov 16 18:04:10 user nova-compute[75342]:         <nova:user uuid="c0e629a008074df3a1ae71096540d77c">tempest-VolumesActionsTest-528330809-project-member</nova:user>
Nov 16 18:04:10 user nova-compute[75342]:         <nova:project uuid="1d6892c1b7794d41a275f70883125d11">tempest-VolumesActionsTest-528330809</nova:project>
Nov 16 18:04:10 user nova-compute[75342]:       </nova:owner>
Nov 16 18:04:10 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:04:10 user nova-compute[75342]:       <nova:ports>
Nov 16 18:04:10 user nova-compute[75342]:         <nova:port uuid="b89571ae-400a-4458-a0f9-3f7ab07b2ca0">
Nov 16 18:04:10 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 18:04:10 user nova-compute[75342]:         </nova:port>
Nov 16 18:04:10 user nova-compute[75342]:       </nova:ports>
Nov 16 18:04:10 user nova-compute[75342]:     </nova:instance>
Nov 16 18:04:10 user nova-compute[75342]:   </metadata>
Nov 16 18:04:10 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:04:10 user nova-compute[75342]:     <system>
Nov 16 18:04:10 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:04:10 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:04:10 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:04:10 user nova-compute[75342]:       <entry name="serial">8b5474bd-3446-452a-adb4-63138de26b3d</entry>
Nov 16 18:04:10 user nova-compute[75342]:       <entry name="uuid">8b5474bd-3446-452a-adb4-63138de26b3d</entry>
Nov 16 18:04:10 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:04:10 user nova-compute[75342]:     </system>
Nov 16 18:04:10 user nova-compute[75342]:   </sysinfo>
Nov 16 18:04:10 user nova-compute[75342]:   <os>
Nov 16 18:04:10 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:04:10 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:04:10 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:04:10 user nova-compute[75342]:   </os>
Nov 16 18:04:10 user nova-compute[75342]:   <features>
Nov 16 18:04:10 user nova-compute[75342]:     <acpi/>
Nov 16 18:04:10 user nova-compute[75342]:     <apic/>
Nov 16 18:04:10 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:04:10 user nova-compute[75342]:   </features>
Nov 16 18:04:10 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:04:10 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:04:10 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:04:10 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:04:10 user nova-compute[75342]:   </clock>
Nov 16 18:04:10 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:04:10 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:04:10 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:04:10 user nova-compute[75342]:   </cpu>
Nov 16 18:04:10 user nova-compute[75342]:   <devices>
Nov 16 18:04:10 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:04:10 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:04:10 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk"/>
Nov 16 18:04:10 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:04:10 user nova-compute[75342]:     </disk>
Nov 16 18:04:10 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:04:10 user nova-compute[75342]:       <mac address="fa:16:3e:a3:05:62"/>
Nov 16 18:04:10 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:04:10 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:04:10 user nova-compute[75342]:       <target dev="tapb89571ae-40"/>
Nov 16 18:04:10 user nova-compute[75342]:     </interface>
Nov 16 18:04:10 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:04:10 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/console.log" append="off"/>
Nov 16 18:04:10 user nova-compute[75342]:     </serial>
Nov 16 18:04:10 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:04:10 user nova-compute[75342]:     <video>
Nov 16 18:04:10 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:04:10 user nova-compute[75342]:     </video>
Nov 16 18:04:10 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:04:10 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:04:10 user nova-compute[75342]:     </rng>
Nov 16 18:04:10 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:04:10 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:04:10 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:04:10 user nova-compute[75342]:     </memballoon>
Nov 16 18:04:10 user nova-compute[75342]:   </devices>
Nov 16 18:04:10 user nova-compute[75342]: </domain>
Nov 16 18:04:10 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-955240700',display_name='tempest-VolumesActionsTest-instance-955240700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-955240700',id=20,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6892c1b7794d41a275f70883125d11',ramdisk_id='',reservation_id='r-rc26wq6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-528330809',owner_user_name='tempest-VolumesActionsTest-528330809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:04:08Z,user_data=None,user_id='c0e629a008074df3a1ae71096540d77c',uuid=8b5474bd-3446-452a-adb4-63138de26b3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "address": "fa:16:3e:a3:05:62", "network": {"id": "b2a9154b-3516-4b0d-81bf-834846aafa8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450872312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6892c1b7794d41a275f70883125d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89571ae-40", "ovs_interfaceid": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Converting VIF {"id": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "address": "fa:16:3e:a3:05:62", "network": {"id": "b2a9154b-3516-4b0d-81bf-834846aafa8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450872312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6892c1b7794d41a275f70883125d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89571ae-40", "ovs_interfaceid": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:62,bridge_name='br-int',has_traffic_filtering=True,id=b89571ae-400a-4458-a0f9-3f7ab07b2ca0,network=Network(b2a9154b-3516-4b0d-81bf-834846aafa8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89571ae-40') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG os_vif [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:62,bridge_name='br-int',has_traffic_filtering=True,id=b89571ae-400a-4458-a0f9-3f7ab07b2ca0,network=Network(b2a9154b-3516-4b0d-81bf-834846aafa8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89571ae-40') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3685a409-b0d4-586d-9a46-446dadf701a2', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb89571ae-40, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb89571ae-40, col_values=(('qos', UUID('1cc69a81-c113-427b-967d-a9a24613b07a')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb89571ae-40, col_values=(('external_ids', {'iface-id': 'b89571ae-400a-4458-a0f9-3f7ab07b2ca0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:05:62', 'vm-uuid': '8b5474bd-3446-452a-adb4-63138de26b3d'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:10 user nova-compute[75342]: INFO nova.compute.manager [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Took 8.05 seconds to spawn the instance on the hypervisor.
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:10 user nova-compute[75342]: INFO os_vif [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:62,bridge_name='br-int',has_traffic_filtering=True,id=b89571ae-400a-4458-a0f9-3f7ab07b2ca0,network=Network(b2a9154b-3516-4b0d-81bf-834846aafa8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89571ae-40')
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] No VIF found with MAC fa:16:3e:a3:05:62, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:04:10 user nova-compute[75342]: INFO nova.compute.manager [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Took 9.25 seconds to build instance.
Nov 16 18:04:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-05a8ca95-0469-48f0-86d5-bd50aabe2a9b tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.407s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.network.neutron [req-96680a33-dffd-46da-aa8b-a2b25b41d59b req-4b4e5887-11e6-456e-aa1b-c385ed30c6c1 service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Updated VIF entry in instance network info cache for port b89571ae-400a-4458-a0f9-3f7ab07b2ca0. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG nova.network.neutron [req-96680a33-dffd-46da-aa8b-a2b25b41d59b req-4b4e5887-11e6-456e-aa1b-c385ed30c6c1 service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Updating instance_info_cache with network_info: [{"id": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "address": "fa:16:3e:a3:05:62", "network": {"id": "b2a9154b-3516-4b0d-81bf-834846aafa8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450872312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6892c1b7794d41a275f70883125d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89571ae-40", "ovs_interfaceid": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:04:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-96680a33-dffd-46da-aa8b-a2b25b41d59b req-4b4e5887-11e6-456e-aa1b-c385ed30c6c1 service nova] Releasing lock "refresh_cache-8b5474bd-3446-452a-adb4-63138de26b3d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:04:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-a3c05e5c-0251-4391-ae54-a48ab990b4e0 req-9aabe6a0-a2a1-43d1-ba20-455f27e6fade service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Received event network-vif-plugged-b89571ae-400a-4458-a0f9-3f7ab07b2ca0 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a3c05e5c-0251-4391-ae54-a48ab990b4e0 req-9aabe6a0-a2a1-43d1-ba20-455f27e6fade service nova] Acquiring lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a3c05e5c-0251-4391-ae54-a48ab990b4e0 req-9aabe6a0-a2a1-43d1-ba20-455f27e6fade service nova] Lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a3c05e5c-0251-4391-ae54-a48ab990b4e0 req-9aabe6a0-a2a1-43d1-ba20-455f27e6fade service nova] Lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-a3c05e5c-0251-4391-ae54-a48ab990b4e0 req-9aabe6a0-a2a1-43d1-ba20-455f27e6fade service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] No waiting events found dispatching network-vif-plugged-b89571ae-400a-4458-a0f9-3f7ab07b2ca0 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:11 user nova-compute[75342]: WARNING nova.compute.manager [req-a3c05e5c-0251-4391-ae54-a48ab990b4e0 req-9aabe6a0-a2a1-43d1-ba20-455f27e6fade service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Received unexpected event network-vif-plugged-b89571ae-400a-4458-a0f9-3f7ab07b2ca0 for instance with vm_state building and task_state spawning.
Nov 16 18:04:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.compute.manager [req-f8672a8b-e4d8-4217-a10f-1c1d6eb81264 req-84d1bab3-8794-406d-8145-572087df1db3 service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Received event network-vif-plugged-b89571ae-400a-4458-a0f9-3f7ab07b2ca0 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f8672a8b-e4d8-4217-a10f-1c1d6eb81264 req-84d1bab3-8794-406d-8145-572087df1db3 service nova] Acquiring lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f8672a8b-e4d8-4217-a10f-1c1d6eb81264 req-84d1bab3-8794-406d-8145-572087df1db3 service nova] Lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f8672a8b-e4d8-4217-a10f-1c1d6eb81264 req-84d1bab3-8794-406d-8145-572087df1db3 service nova] Lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.compute.manager [req-f8672a8b-e4d8-4217-a10f-1c1d6eb81264 req-84d1bab3-8794-406d-8145-572087df1db3 service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] No waiting events found dispatching network-vif-plugged-b89571ae-400a-4458-a0f9-3f7ab07b2ca0 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:14 user nova-compute[75342]: WARNING nova.compute.manager [req-f8672a8b-e4d8-4217-a10f-1c1d6eb81264 req-84d1bab3-8794-406d-8145-572087df1db3 service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Received unexpected event network-vif-plugged-b89571ae-400a-4458-a0f9-3f7ab07b2ca0 for instance with vm_state building and task_state spawning.
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:04:14 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Instance spawned successfully.
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:04:14 user nova-compute[75342]: INFO nova.compute.manager [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 16 18:04:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:04:14 user nova-compute[75342]: INFO nova.compute.manager [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Took 8.03 seconds to build instance.
Nov 16 18:04:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4e053e7e-69b3-4662-819c-359c4ea2fa81 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "8b5474bd-3446-452a-adb4-63138de26b3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.146s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:35 user nova-compute[75342]: INFO nova.compute.manager [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Rescuing
Nov 16 18:04:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:04:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquired lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:04:35 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:04:35 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Updating instance_info_cache with network_info: [{"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:04:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Releasing lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG nova.compute.manager [req-6435b6f8-75fe-45d7-aef6-23b5c70a77b7 req-e66d0763-319d-484a-9243-94274e9608f0 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-unplugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6435b6f8-75fe-45d7-aef6-23b5c70a77b7 req-e66d0763-319d-484a-9243-94274e9608f0 service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6435b6f8-75fe-45d7-aef6-23b5c70a77b7 req-e66d0763-319d-484a-9243-94274e9608f0 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6435b6f8-75fe-45d7-aef6-23b5c70a77b7 req-e66d0763-319d-484a-9243-94274e9608f0 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG nova.compute.manager [req-6435b6f8-75fe-45d7-aef6-23b5c70a77b7 req-e66d0763-319d-484a-9243-94274e9608f0 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-unplugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:36 user nova-compute[75342]: WARNING nova.compute.manager [req-6435b6f8-75fe-45d7-aef6-23b5c70a77b7 req-e66d0763-319d-484a-9243-94274e9608f0 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received unexpected event network-vif-unplugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with vm_state active and task_state rescuing.
Nov 16 18:04:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:04:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Instance destroyed successfully.
Nov 16 18:04:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Attempting a stable device rescue
Nov 16 18:04:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75342) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Instance directory exists: not creating {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 18:04:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Creating image(s)
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "/opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "/opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "/opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'trusted_certs' on Instance uuid 78afab8c-3e7c-4697-86b8-726c6ed252c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "263b17b98bd93cc7fe90329920b779be92f36ef3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "263b17b98bd93cc7fe90329920b779be92f36ef3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3.part --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3.part --force-share --output=json" returned: 0 in 0.233s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG nova.virt.images [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] b2c51203-c4be-48cc-a638-6cbdf3b2cefa was qcow2, converting to raw {{(pid=75342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3.part /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3.converted {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-56c018ae-c81e-47ca-a53d-01844e6cf462 req-b04c364f-0aa0-4a6d-ba94-a59c70485b74 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-56c018ae-c81e-47ca-a53d-01844e6cf462 req-b04c364f-0aa0-4a6d-ba94-a59c70485b74 service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-56c018ae-c81e-47ca-a53d-01844e6cf462 req-b04c364f-0aa0-4a6d-ba94-a59c70485b74 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-56c018ae-c81e-47ca-a53d-01844e6cf462 req-b04c364f-0aa0-4a6d-ba94-a59c70485b74 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-56c018ae-c81e-47ca-a53d-01844e6cf462 req-b04c364f-0aa0-4a6d-ba94-a59c70485b74 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:38 user nova-compute[75342]: WARNING nova.compute.manager [req-56c018ae-c81e-47ca-a53d-01844e6cf462 req-b04c364f-0aa0-4a6d-ba94-a59c70485b74 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received unexpected event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with vm_state active and task_state rescuing.
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3.part /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3.converted" returned: 0 in 0.698s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3.converted --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.489s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "263b17b98bd93cc7fe90329920b779be92f36ef3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.039s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "263b17b98bd93cc7fe90329920b779be92f36ef3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "263b17b98bd93cc7fe90329920b779be92f36ef3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3 --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3,backing_fmt=raw /opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/disk.rescue {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3,backing_fmt=raw /opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/disk.rescue" returned: 0 in 0.048s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "263b17b98bd93cc7fe90329920b779be92f36ef3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'migration_context' on Instance uuid 78afab8c-3e7c-4697-86b8-726c6ed252c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.objects.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Object Instance<78afab8c-3e7c-4697-86b8-726c6ed252c5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Start _get_guest_xml network_info=[{"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "vif_mac": "fa:16:3e:32:a2:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b2c51203-c4be-48cc-a638-6cbdf3b2cefa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'eeef062f-e6bb-49cb-a36c-4784bd800946', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbNZPLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '78afab8c-3e7c-4697-86b8-726c6ed252c5', 'attached_at': '', 'detached_at': '', 'volume_id': 'c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5', 'serial': 'c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'resources' on Instance uuid 78afab8c-3e7c-4697-86b8-726c6ed252c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.objects.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Object Instance<78afab8c-3e7c-4697-86b8-726c6ed252c5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'numa_topology' on Instance uuid 78afab8c-3e7c-4697-86b8-726c6ed252c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.objects.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Object Instance<78afab8c-3e7c-4697-86b8-726c6ed252c5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:04:39 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:39 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'vcpu_model' on Instance uuid 78afab8c-3e7c-4697-86b8-726c6ed252c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.objects.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Object Instance<78afab8c-3e7c-4697-86b8-726c6ed252c5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbNZPLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:04:39 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:04:39 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:04:39 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0b5a12-e949-48d6-b694-9f36459c26c8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = FbNZPLjf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 18:04:39 user nova-compute[75342]: node.name = iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:04:39 user nova-compute[75342]: node.tpgt = -1
Nov 16 18:04:39 user nova-compute[75342]: node.startup = automatic
Nov 16 18:04:39 user nova-compute[75342]: node.leading_login = No
Nov 16 18:04:39 user nova-compute[75342]: iface.iscsi_ifacename = default
Nov 16 18:04:39 user nova-compute[75342]: iface.net_ifacename = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.ipaddress = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.prefix_len = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.hwaddress = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.transport_name = tcp
Nov 16 18:04:39 user nova-compute[75342]: iface.initiatorname = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.state = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.vlan_id = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.vlan_priority = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.vlan_state = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.iface_num = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.mtu = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.port = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.bootproto = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.subnet_mask = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.gateway = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.dhcp_alt_client_id = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.dhcp_dns = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.dhcp_learn_iqn = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.dhcp_vendor_id_state = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.dhcp_vendor_id = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.dhcp_slp_da = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.fragmentation = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.gratuitous_arp = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.incoming_forwarding = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.tos_state = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.tos = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.ttl = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.delayed_ack = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.tcp_nagle = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.tcp_wsf_state = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.tcp_wsf = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.tcp_timer_scale = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.tcp_timestamp = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.redirect = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.def_task_mgmt_timeout = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.header_digest = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.data_digest = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.immediate_data = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.initial_r2t = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.data_seq_inorder = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.data_pdu_inorder = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.erl = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.max_receive_data_len = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.first_burst_len = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.max_outstanding_r2t = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.max_burst_len = 0
Nov 16 18:04:39 user nova-compute[75342]: iface.chap_auth = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.bidi_chap = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.strict_login_compliance = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.discovery_auth = <empty>
Nov 16 18:04:39 user nova-compute[75342]: iface.discovery_logout = <empty>
Nov 16 18:04:39 user nova-compute[75342]: node.discovery_address = <empty>
Nov 16 18:04:39 user nova-compute[75342]: node.discovery_port = 0
Nov 16 18:04:39 user nova-compute[75342]: node.discovery_type = static
Nov 16 18:04:39 user nova-compute[75342]: node.session.initial_cmdsn = 0
Nov 16 18:04:39 user nova-compute[75342]: node.session.initial_login_retry_max = 8
Nov 16 18:04:39 user nova-compute[75342]: node.session.xmit_thread_priority = -20
Nov 16 18:04:39 user nova-compute[75342]: node.session.cmds_max = 128
Nov 16 18:04:39 user nova-compute[75342]: node.session.queue_depth = 32
Nov 16 18:04:39 user nova-compute[75342]: node.session.nr_sessions = 1
Nov 16 18:04:39 user nova-compute[75342]: node.session.auth.authmethod = CHAP
Nov 16 18:04:39 user nova-compute[75342]: node.session.auth.username = FbNZPLjf
Nov 16 18:04:39 user nova-compute[75342]: node.session.auth.password = ***
Nov 16 18:04:39 user nova-compute[75342]: node.session.auth.username_in = <empty>
Nov 16 18:04:39 user nova-compute[75342]: node.session.auth.password_in = <empty>
Nov 16 18:04:39 user nova-compute[75342]: node.session.auth.chap_algs = MD5
Nov 16 18:04:39 user nova-compute[75342]: node.session.timeo.replacement_timeout = 120
Nov 16 18:04:39 user nova-compute[75342]: node.session.err_timeo.abort_timeout = 15
Nov 16 18:04:39 user nova-compute[75342]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 18:04:39 user nova-compute[75342]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 18:04:39 user nova-compute[75342]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 18:04:39 user nova-compute[75342]: node.session.iscsi.FastAbort = Yes
Nov 16 18:04:39 user nova-compute[75342]: node.session.iscsi.InitialR2T = No
Nov 16 18:04:39 user nova-compute[75342]: node.session.iscsi.ImmediateData = Yes
Nov 16 18:04:39 user nova-compute[75342]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 18:04:39 user nova-compute[75342]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 18:04:39 user nova-compute[75342]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 18:04:39 user nova-compute[75342]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 18:04:39 user nova-compute[75342]: node.session.iscsi.MaxConnections = 1
Nov 16 18:04:39 user nova-compute[75342]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 18:04:39 user nova-compute[75342]: node.session.iscsi.ERL = 0
Nov 16 18:04:39 user nova-compute[75342]: node.session.scan = manual
Nov 16 18:04:39 user nova-compute[75342]: node.session.reopen_max = 0
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].address = 172.16.0.220
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].port = 3260
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].startup = manual
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].tcp.window_size = 524288
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].tcp.type_of_service = 0
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].timeo.logout_timeout = 15
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].timeo.login_timeout = 15
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].timeo.auth_timeout = 45
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].iscsi.DataDigest = None
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].iscsi.IFMarker = No
Nov 16 18:04:39 user nova-compute[75342]: node.conn[0].iscsi.OFMarker = No
Nov 16 18:04:39 user nova-compute[75342]: # END RECORD
Nov 16 18:04:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f714f5f2-ce94-4e61-92e2-08b8b28b8721]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70d110e-4537-45ad-bda9-664746d6df81]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbNZPLjf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbNZPLjf" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a53f92b-d49b-4e8f-9250-49026452e196]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FbNZPLjf'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a929c9ec-8e14-4781-94b2-3accc443d712]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[031e31b6-195b-48f1-aff3-ab227b9024fd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:04:39 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:04:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:04:39 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:04:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.206s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] HCTL ('35', '0', '0', 0) found on session 19 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d8f8e5-3824-4f19-a21a-d448a2754c5e]: (4, ('0 0 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching for a device in session 19 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbNZPLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.233s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] <== connect_volume: return (235ms) {'type': 'block', 'scsi_wwn': '23466386161326536', 'path': '/dev/sdd'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466386161326536', 'path': '/dev/sdd'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670881738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670881738',id=13,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:03:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-f1kum1ys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:04Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=78afab8c-3e7c-4697-86b8-726c6ed252c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "vif_mac": "fa:16:3e:32:a2:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "vif_mac": "fa:16:3e:32:a2:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=3412866c-1a34-4be9-91b5-37959486c6cc,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3412866c-1a') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'pci_devices' on Instance uuid 78afab8c-3e7c-4697-86b8-726c6ed252c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.objects.base [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Object Instance<78afab8c-3e7c-4697-86b8-726c6ed252c5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:04:39 user nova-compute[75342]:   <uuid>78afab8c-3e7c-4697-86b8-726c6ed252c5</uuid>
Nov 16 18:04:39 user nova-compute[75342]:   <name>instance-0000000d</name>
Nov 16 18:04:39 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:04:39 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:04:39 user nova-compute[75342]:   <metadata>
Nov 16 18:04:39 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:04:39 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:04:39 user nova-compute[75342]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1670881738</nova:name>
Nov 16 18:04:39 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:04:39</nova:creationTime>
Nov 16 18:04:39 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:04:39 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:04:39 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:04:39 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:04:39 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:04:39 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:04:39 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:04:39 user nova-compute[75342]:       <nova:owner>
Nov 16 18:04:39 user nova-compute[75342]:         <nova:user uuid="13beba5fa97a448fa863135a45e47cb9">tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member</nova:user>
Nov 16 18:04:39 user nova-compute[75342]:         <nova:project uuid="4542bb854a1647618ba3995c4342109a">tempest-ServerBootFromVolumeStableRescueTest-764398626</nova:project>
Nov 16 18:04:39 user nova-compute[75342]:       </nova:owner>
Nov 16 18:04:39 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:04:39 user nova-compute[75342]:       <nova:ports>
Nov 16 18:04:39 user nova-compute[75342]:         <nova:port uuid="3412866c-1a34-4be9-91b5-37959486c6cc">
Nov 16 18:04:39 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 18:04:39 user nova-compute[75342]:         </nova:port>
Nov 16 18:04:39 user nova-compute[75342]:       </nova:ports>
Nov 16 18:04:39 user nova-compute[75342]:     </nova:instance>
Nov 16 18:04:39 user nova-compute[75342]:   </metadata>
Nov 16 18:04:39 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:04:39 user nova-compute[75342]:     <system>
Nov 16 18:04:39 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:04:39 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:04:39 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:04:39 user nova-compute[75342]:       <entry name="serial">78afab8c-3e7c-4697-86b8-726c6ed252c5</entry>
Nov 16 18:04:39 user nova-compute[75342]:       <entry name="uuid">78afab8c-3e7c-4697-86b8-726c6ed252c5</entry>
Nov 16 18:04:39 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:04:39 user nova-compute[75342]:     </system>
Nov 16 18:04:39 user nova-compute[75342]:   </sysinfo>
Nov 16 18:04:39 user nova-compute[75342]:   <os>
Nov 16 18:04:39 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:04:39 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:04:39 user nova-compute[75342]:   </os>
Nov 16 18:04:39 user nova-compute[75342]:   <features>
Nov 16 18:04:39 user nova-compute[75342]:     <acpi/>
Nov 16 18:04:39 user nova-compute[75342]:     <apic/>
Nov 16 18:04:39 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:04:39 user nova-compute[75342]:   </features>
Nov 16 18:04:39 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:04:39 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:04:39 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:04:39 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:04:39 user nova-compute[75342]:   </clock>
Nov 16 18:04:39 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:04:39 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:04:39 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:04:39 user nova-compute[75342]:   </cpu>
Nov 16 18:04:39 user nova-compute[75342]:   <devices>
Nov 16 18:04:39 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:04:39 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:04:39 user nova-compute[75342]:       <source dev="/dev/sdd"/>
Nov 16 18:04:39 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:04:39 user nova-compute[75342]:       <serial>c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5</serial>
Nov 16 18:04:39 user nova-compute[75342]:     </disk>
Nov 16 18:04:39 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:04:39 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:04:39 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/disk.rescue"/>
Nov 16 18:04:39 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:04:39 user nova-compute[75342]:       <boot order="1"/>
Nov 16 18:04:39 user nova-compute[75342]:     </disk>
Nov 16 18:04:39 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:04:39 user nova-compute[75342]:       <mac address="fa:16:3e:32:a2:86"/>
Nov 16 18:04:39 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:04:39 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:04:39 user nova-compute[75342]:       <target dev="tap3412866c-1a"/>
Nov 16 18:04:39 user nova-compute[75342]:     </interface>
Nov 16 18:04:39 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:04:39 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/console.log" append="off"/>
Nov 16 18:04:39 user nova-compute[75342]:     </serial>
Nov 16 18:04:39 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:04:39 user nova-compute[75342]:     <video>
Nov 16 18:04:39 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:04:39 user nova-compute[75342]:     </video>
Nov 16 18:04:39 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:04:39 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:04:39 user nova-compute[75342]:     </rng>
Nov 16 18:04:39 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:04:39 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:04:39 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:04:39 user nova-compute[75342]:     </memballoon>
Nov 16 18:04:39 user nova-compute[75342]:   </devices>
Nov 16 18:04:39 user nova-compute[75342]: </domain>
Nov 16 18:04:39 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:04:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Instance destroyed successfully.
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No VIF found with MAC fa:16:3e:32:a2:86, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-80cc325a-f0a6-4b1a-bc79-98151b2cad5d req-b2cfe019-4a8e-4486-95ad-2438873e0a2d service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-80cc325a-f0a6-4b1a-bc79-98151b2cad5d req-b2cfe019-4a8e-4486-95ad-2438873e0a2d service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-80cc325a-f0a6-4b1a-bc79-98151b2cad5d req-b2cfe019-4a8e-4486-95ad-2438873e0a2d service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-80cc325a-f0a6-4b1a-bc79-98151b2cad5d req-b2cfe019-4a8e-4486-95ad-2438873e0a2d service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-80cc325a-f0a6-4b1a-bc79-98151b2cad5d req-b2cfe019-4a8e-4486-95ad-2438873e0a2d service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:41 user nova-compute[75342]: WARNING nova.compute.manager [req-80cc325a-f0a6-4b1a-bc79-98151b2cad5d req-b2cfe019-4a8e-4486-95ad-2438873e0a2d service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received unexpected event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with vm_state active and task_state rescuing.
Nov 16 18:04:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-665a0f1a-cb67-418a-bd88-312b2b5fe07a req-bac5c1d8-c054-49b9-88d6-e5f14a79ebd6 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665a0f1a-cb67-418a-bd88-312b2b5fe07a req-bac5c1d8-c054-49b9-88d6-e5f14a79ebd6 service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665a0f1a-cb67-418a-bd88-312b2b5fe07a req-bac5c1d8-c054-49b9-88d6-e5f14a79ebd6 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-665a0f1a-cb67-418a-bd88-312b2b5fe07a req-bac5c1d8-c054-49b9-88d6-e5f14a79ebd6 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-665a0f1a-cb67-418a-bd88-312b2b5fe07a req-bac5c1d8-c054-49b9-88d6-e5f14a79ebd6 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:43 user nova-compute[75342]: WARNING nova.compute.manager [req-665a0f1a-cb67-418a-bd88-312b2b5fe07a req-bac5c1d8-c054-49b9-88d6-e5f14a79ebd6 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received unexpected event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with vm_state active and task_state rescuing.
Nov 16 18:04:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c39633c-12e0-45ac-809f-2a4351d26467 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:04:43 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:43 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7061MB free_disk=25.382434844970703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:04:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Applying migration context for instance 2992b5fc-86e6-425f-82e5-cf6358582872 as it has an incoming, in-progress migration b36afc8d-d0e3-4613-9dd5-227b0080649d. Migration status is finished {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 18:04:44 user nova-compute[75342]: INFO nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating resource usage from migration b36afc8d-d0e3-4613-9dd5-227b0080649d
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 2b4221b3-7f0d-4299-8bf2-865a46133a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Migration b36afc8d-d0e3-4613-9dd5-227b0080649d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 2992b5fc-86e6-425f-82e5-cf6358582872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c6408c85-ed86-4b11-afa6-14f93b92492c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance fb00d09d-d7c3-43f8-a118-26868011460b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 8b5474bd-3446-452a-adb4-63138de26b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:04:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.733s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:45 user nova-compute[75342]: INFO nova.compute.manager [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Terminating instance
Nov 16 18:04:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-2fbe9812-40ca-4a7b-a5e5-ee4cdd022517 req-2c8abb2c-dfc5-4f6d-aa4e-e5048c429e62 service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Received event network-vif-unplugged-201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2fbe9812-40ca-4a7b-a5e5-ee4cdd022517 req-2c8abb2c-dfc5-4f6d-aa4e-e5048c429e62 service nova] Acquiring lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2fbe9812-40ca-4a7b-a5e5-ee4cdd022517 req-2c8abb2c-dfc5-4f6d-aa4e-e5048c429e62 service nova] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2fbe9812-40ca-4a7b-a5e5-ee4cdd022517 req-2c8abb2c-dfc5-4f6d-aa4e-e5048c429e62 service nova] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-2fbe9812-40ca-4a7b-a5e5-ee4cdd022517 req-2c8abb2c-dfc5-4f6d-aa4e-e5048c429e62 service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] No waiting events found dispatching network-vif-unplugged-201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-2fbe9812-40ca-4a7b-a5e5-ee4cdd022517 req-2c8abb2c-dfc5-4f6d-aa4e-e5048c429e62 service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Received event network-vif-unplugged-201edf7f-0ff2-4878-aa2f-431868b79042 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Instance destroyed successfully.
Nov 16 18:04:45 user nova-compute[75342]: DEBUG nova.objects.instance [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lazy-loading 'resources' on Instance uuid 2b4221b3-7f0d-4299-8bf2-865a46133a9e {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1746490084',display_name='tempest-VolumesAdminNegativeTest-server-1746490084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1746490084',id=14,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d1f044ccaee41cfa073d66a26578f3d',ramdisk_id='',reservation_id='r-7egy1lkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2111670408',owner_user_name='tempest-VolumesAdminNegativeTest-2111670408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:02:58Z,user_data=None,user_id='f21531e56db949a0a0a30925635a35d4',uuid=2b4221b3-7f0d-4299-8bf2-865a46133a9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "201edf7f-0ff2-4878-aa2f-431868b79042", "address": "fa:16:3e:94:16:c4", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201edf7f-0f", "ovs_interfaceid": "201edf7f-0ff2-4878-aa2f-431868b79042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converting VIF {"id": "201edf7f-0ff2-4878-aa2f-431868b79042", "address": "fa:16:3e:94:16:c4", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201edf7f-0f", "ovs_interfaceid": "201edf7f-0ff2-4878-aa2f-431868b79042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=201edf7f-0ff2-4878-aa2f-431868b79042,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201edf7f-0f') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG os_vif [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=201edf7f-0ff2-4878-aa2f-431868b79042,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201edf7f-0f') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap201edf7f-0f, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dc99ee4-dc25-42c3-9120-7296045f4e02) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:04:45 user nova-compute[75342]: INFO os_vif [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=201edf7f-0ff2-4878-aa2f-431868b79042,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201edf7f-0f')
Nov 16 18:04:45 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Deleting instance files /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e_del
Nov 16 18:04:45 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Deletion of /opt/stack/data/nova/instances/2b4221b3-7f0d-4299-8bf2-865a46133a9e_del complete
Nov 16 18:04:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:04:46 user nova-compute[75342]: INFO nova.compute.manager [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 18:04:46 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Updating instance_info_cache with network_info: [{"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:04:46 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Took 0.55 seconds to deallocate network for instance.
Nov 16 18:04:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-bc09fc5a-5b2f-4e5a-812d-4416535bdb9c req-49c3cdc8-48be-4f32-aceb-9396096ccd48 service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Received event network-vif-deleted-201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:46 user nova-compute[75342]: INFO nova.compute.manager [req-bc09fc5a-5b2f-4e5a-812d-4416535bdb9c req-49c3cdc8-48be-4f32-aceb-9396096ccd48 service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Neutron deleted interface 201edf7f-0ff2-4878-aa2f-431868b79042; detaching it from the instance and deleting it from the info cache
Nov 16 18:04:46 user nova-compute[75342]: DEBUG nova.network.neutron [req-bc09fc5a-5b2f-4e5a-812d-4416535bdb9c req-49c3cdc8-48be-4f32-aceb-9396096ccd48 service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-bc09fc5a-5b2f-4e5a-812d-4416535bdb9c req-49c3cdc8-48be-4f32-aceb-9396096ccd48 service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Detach interface failed, port_id=201edf7f-0ff2-4878-aa2f-431868b79042, reason: Instance 2b4221b3-7f0d-4299-8bf2-865a46133a9e could not be found. {{(pid=75342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:47 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:04:47 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:04:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:47 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Deleted allocations for instance 2b4221b3-7f0d-4299-8bf2-865a46133a9e
Nov 16 18:04:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-edd53316-87c3-4436-9a90-948d4b59eae2 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-58c3270c-0e6f-453a-a14d-f99209aa7e14 req-8963a5a4-8cc9-4e08-a4ed-c9b676e99ace service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Received event network-vif-plugged-201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58c3270c-0e6f-453a-a14d-f99209aa7e14 req-8963a5a4-8cc9-4e08-a4ed-c9b676e99ace service nova] Acquiring lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58c3270c-0e6f-453a-a14d-f99209aa7e14 req-8963a5a4-8cc9-4e08-a4ed-c9b676e99ace service nova] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58c3270c-0e6f-453a-a14d-f99209aa7e14 req-8963a5a4-8cc9-4e08-a4ed-c9b676e99ace service nova] Lock "2b4221b3-7f0d-4299-8bf2-865a46133a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-58c3270c-0e6f-453a-a14d-f99209aa7e14 req-8963a5a4-8cc9-4e08-a4ed-c9b676e99ace service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] No waiting events found dispatching network-vif-plugged-201edf7f-0ff2-4878-aa2f-431868b79042 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:47 user nova-compute[75342]: WARNING nova.compute.manager [req-58c3270c-0e6f-453a-a14d-f99209aa7e14 req-8963a5a4-8cc9-4e08-a4ed-c9b676e99ace service nova] [instance: 2b4221b3-7f0d-4299-8bf2-865a46133a9e] Received unexpected event network-vif-plugged-201edf7f-0ff2-4878-aa2f-431868b79042 for instance with vm_state deleted and task_state None.
Nov 16 18:04:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:49 user nova-compute[75342]: INFO nova.compute.manager [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Rescuing
Nov 16 18:04:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:04:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquired lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:04:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:04:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Updating instance_info_cache with network_info: [{"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:04:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Releasing lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:04:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-67263a6d-f95f-4442-965d-7bffdc262066 req-e84fa0c8-3dd0-48bb-adea-7d280b22a7e8 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received event network-vif-unplugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-67263a6d-f95f-4442-965d-7bffdc262066 req-e84fa0c8-3dd0-48bb-adea-7d280b22a7e8 service nova] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-67263a6d-f95f-4442-965d-7bffdc262066 req-e84fa0c8-3dd0-48bb-adea-7d280b22a7e8 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-67263a6d-f95f-4442-965d-7bffdc262066 req-e84fa0c8-3dd0-48bb-adea-7d280b22a7e8 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-67263a6d-f95f-4442-965d-7bffdc262066 req-e84fa0c8-3dd0-48bb-adea-7d280b22a7e8 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] No waiting events found dispatching network-vif-unplugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:50 user nova-compute[75342]: WARNING nova.compute.manager [req-67263a6d-f95f-4442-965d-7bffdc262066 req-e84fa0c8-3dd0-48bb-adea-7d280b22a7e8 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received unexpected event network-vif-unplugged-804687ae-e749-44ee-ada3-856923763b9b for instance with vm_state active and task_state rescuing.
Nov 16 18:04:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Instance destroyed successfully.
Nov 16 18:04:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Attempting rescue
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75342) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Instance directory exists: not creating {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 18:04:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Creating image(s)
Nov 16 18:04:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue" returned: 0 in 0.049s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'migration_context' on Instance uuid bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.objects.base [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Start _get_guest_xml network_info=[{"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "vif_mac": "fa:16:3e:b9:0f:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'resources' on Instance uuid bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.objects.base [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'numa_topology' on Instance uuid bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.objects.base [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:04:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.objects.base [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-133130086',display_name='tempest-ServerRescueNegativeTestJSON-server-133130086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-133130086',id=16,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:03:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-1niwqwea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:08Z,user_data=None,user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "vif_mac": "fa:16:3e:b9:0f:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "vif_mac": "fa:16:3e:b9:0f:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:0f:de,bridge_name='br-int',has_traffic_filtering=True,id=804687ae-e749-44ee-ada3-856923763b9b,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804687ae-e7') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'pci_devices' on Instance uuid bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.objects.base [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:04:51 user nova-compute[75342]:   <uuid>bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f</uuid>
Nov 16 18:04:51 user nova-compute[75342]:   <name>instance-00000010</name>
Nov 16 18:04:51 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:04:51 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:04:51 user nova-compute[75342]:   <metadata>
Nov 16 18:04:51 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:04:51 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:04:51 user nova-compute[75342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-133130086</nova:name>
Nov 16 18:04:51 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:04:51</nova:creationTime>
Nov 16 18:04:51 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:04:51 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:04:51 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:04:51 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:04:51 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:04:51 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:04:51 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:04:51 user nova-compute[75342]:       <nova:owner>
Nov 16 18:04:51 user nova-compute[75342]:         <nova:user uuid="0697a15cd0054cef90459da99a3fd8ec">tempest-ServerRescueNegativeTestJSON-935902109-project-member</nova:user>
Nov 16 18:04:51 user nova-compute[75342]:         <nova:project uuid="02d87f343b6e4dbead83e037619ae49c">tempest-ServerRescueNegativeTestJSON-935902109</nova:project>
Nov 16 18:04:51 user nova-compute[75342]:       </nova:owner>
Nov 16 18:04:51 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:04:51 user nova-compute[75342]:       <nova:ports>
Nov 16 18:04:51 user nova-compute[75342]:         <nova:port uuid="804687ae-e749-44ee-ada3-856923763b9b">
Nov 16 18:04:51 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 18:04:51 user nova-compute[75342]:         </nova:port>
Nov 16 18:04:51 user nova-compute[75342]:       </nova:ports>
Nov 16 18:04:51 user nova-compute[75342]:     </nova:instance>
Nov 16 18:04:51 user nova-compute[75342]:   </metadata>
Nov 16 18:04:51 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:04:51 user nova-compute[75342]:     <system>
Nov 16 18:04:51 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:04:51 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:04:51 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:04:51 user nova-compute[75342]:       <entry name="serial">bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f</entry>
Nov 16 18:04:51 user nova-compute[75342]:       <entry name="uuid">bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f</entry>
Nov 16 18:04:51 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:04:51 user nova-compute[75342]:     </system>
Nov 16 18:04:51 user nova-compute[75342]:   </sysinfo>
Nov 16 18:04:51 user nova-compute[75342]:   <os>
Nov 16 18:04:51 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:04:51 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:04:51 user nova-compute[75342]:   </os>
Nov 16 18:04:51 user nova-compute[75342]:   <features>
Nov 16 18:04:51 user nova-compute[75342]:     <acpi/>
Nov 16 18:04:51 user nova-compute[75342]:     <apic/>
Nov 16 18:04:51 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:04:51 user nova-compute[75342]:   </features>
Nov 16 18:04:51 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:04:51 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:04:51 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:04:51 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:04:51 user nova-compute[75342]:   </clock>
Nov 16 18:04:51 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:04:51 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:04:51 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:04:51 user nova-compute[75342]:   </cpu>
Nov 16 18:04:51 user nova-compute[75342]:   <devices>
Nov 16 18:04:51 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:04:51 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:04:51 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue"/>
Nov 16 18:04:51 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:04:51 user nova-compute[75342]:     </disk>
Nov 16 18:04:51 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:04:51 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:04:51 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk"/>
Nov 16 18:04:51 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:04:51 user nova-compute[75342]:     </disk>
Nov 16 18:04:51 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:04:51 user nova-compute[75342]:       <mac address="fa:16:3e:b9:0f:de"/>
Nov 16 18:04:51 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:04:51 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:04:51 user nova-compute[75342]:       <target dev="tap804687ae-e7"/>
Nov 16 18:04:51 user nova-compute[75342]:     </interface>
Nov 16 18:04:51 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:04:51 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/console.log" append="off"/>
Nov 16 18:04:51 user nova-compute[75342]:     </serial>
Nov 16 18:04:51 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:04:51 user nova-compute[75342]:     <video>
Nov 16 18:04:51 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:04:51 user nova-compute[75342]:     </video>
Nov 16 18:04:51 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:04:51 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:04:51 user nova-compute[75342]:     </rng>
Nov 16 18:04:51 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:04:51 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:04:51 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:04:51 user nova-compute[75342]:     </memballoon>
Nov 16 18:04:51 user nova-compute[75342]:   </devices>
Nov 16 18:04:51 user nova-compute[75342]: </domain>
Nov 16 18:04:51 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:04:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Instance destroyed successfully.
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:04:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No VIF found with MAC fa:16:3e:b9:0f:de, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:04:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-5f879843-d660-47d0-9154-5a34d0da0244 req-0cce69e5-fe43-4ecc-be70-d5da80260653 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5f879843-d660-47d0-9154-5a34d0da0244 req-0cce69e5-fe43-4ecc-be70-d5da80260653 service nova] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5f879843-d660-47d0-9154-5a34d0da0244 req-0cce69e5-fe43-4ecc-be70-d5da80260653 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5f879843-d660-47d0-9154-5a34d0da0244 req-0cce69e5-fe43-4ecc-be70-d5da80260653 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-5f879843-d660-47d0-9154-5a34d0da0244 req-0cce69e5-fe43-4ecc-be70-d5da80260653 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] No waiting events found dispatching network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:52 user nova-compute[75342]: WARNING nova.compute.manager [req-5f879843-d660-47d0-9154-5a34d0da0244 req-0cce69e5-fe43-4ecc-be70-d5da80260653 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received unexpected event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b for instance with vm_state active and task_state rescuing.
Nov 16 18:04:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] No waiting events found dispatching network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:54 user nova-compute[75342]: WARNING nova.compute.manager [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received unexpected event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b for instance with vm_state active and task_state rescuing.
Nov 16 18:04:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:04:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:04:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:04:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:04:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] No waiting events found dispatching network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:04:54 user nova-compute[75342]: WARNING nova.compute.manager [req-e48261cb-9e34-407a-a33d-375140c7d71e req-5893b285-af0a-4a05-b483-710bd69a9d77 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received unexpected event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b for instance with vm_state active and task_state rescuing.
Nov 16 18:04:55 user nova-compute[75342]: DEBUG nova.compute.manager [None req-eda9ecd4-4b8d-4b3e-88da-2b024b6f1916 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:04:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:04:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-31ddc104-d54a-40bb-b837-95cabd70ef1c req-27c67f3f-f102-4118-a6e7-3644366ed60d service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-changed-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-31ddc104-d54a-40bb-b837-95cabd70ef1c req-27c67f3f-f102-4118-a6e7-3644366ed60d service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Refreshing instance network info cache due to event network-changed-f10735e2-a261-4be2-9fc4-2ae2622116b1. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:05:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ddc104-d54a-40bb-b837-95cabd70ef1c req-27c67f3f-f102-4118-a6e7-3644366ed60d service nova] Acquiring lock "refresh_cache-28eaadcb-3f00-4868-8115-b5d4ba9454f3" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:05:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ddc104-d54a-40bb-b837-95cabd70ef1c req-27c67f3f-f102-4118-a6e7-3644366ed60d service nova] Acquired lock "refresh_cache-28eaadcb-3f00-4868-8115-b5d4ba9454f3" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:05:19 user nova-compute[75342]: DEBUG nova.network.neutron [req-31ddc104-d54a-40bb-b837-95cabd70ef1c req-27c67f3f-f102-4118-a6e7-3644366ed60d service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Refreshing network info cache for port f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG nova.network.neutron [req-31ddc104-d54a-40bb-b837-95cabd70ef1c req-27c67f3f-f102-4118-a6e7-3644366ed60d service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Updated VIF entry in instance network info cache for port f10735e2-a261-4be2-9fc4-2ae2622116b1. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG nova.network.neutron [req-31ddc104-d54a-40bb-b837-95cabd70ef1c req-27c67f3f-f102-4118-a6e7-3644366ed60d service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Updating instance_info_cache with network_info: [{"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG nova.objects.instance [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'flavor' on Instance uuid 28eaadcb-3f00-4868-8115-b5d4ba9454f3 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ddc104-d54a-40bb-b837-95cabd70ef1c req-27c67f3f-f102-4118-a6e7-3644366ed60d service nova] Releasing lock "refresh_cache-28eaadcb-3f00-4868-8115-b5d4ba9454f3" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:20 user nova-compute[75342]: INFO nova.compute.manager [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Attaching volume e04bcbb1-af36-4770-8307-c95ec0dc26be to /dev/vdb
Nov 16 18:05:20 user nova-compute[75342]: DEBUG os_brick.utils [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f91e66-5199-4ce9-8609-88e5dedf91a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfb7b7f-0d7a-40b8-9116-bef13d3399c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc99d66-37a9-4f61-adc2-fe58349b103f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c186617e-d2fc-4438-a8b0-de95e1c112bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:05:20 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:05:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[529c6acb-4865-4f77-89f0-269c39235f67]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG os_brick.utils [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Updating existing volume attachment record: ac22b25d-0b06-4b0f-83d5-09297499dbe8 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:05:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibfAcHTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:05:25 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:05:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:05:25 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:05:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:05:25 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[205da15b-05ec-4e4e-88ac-778ad3c9479e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:05:25 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[005708b6-f122-4855-996b-8d87b2e5c7ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be] added
Nov 16 18:05:25 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[73da29c5-3608-4039-96bb-a68b34872b89]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f515f27-59b2-4c32-877b-e7c1065bbcb1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibfAcHTO {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibfAcHTO" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2283529e-84d6-49c2-b8c6-7ef707eaf2d0]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ibfAcHTO'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ad3979-6d06-4b2f-949d-254fd7dea2f1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a2b227-e704-4bbc-9f19-6cf2f0b376c1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:26 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:26 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2528e2-ceae-4fb7-afca-e2b1453a10a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260]
Nov 16 18:05:26 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260] successful.
Nov 16 18:05:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1601e98c-0886-4930-a2f9-5261b5fbb521]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a703d7a5-b2e4-4c94-b153-1e20f43908b0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:26 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:26 user nova-compute[75342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:05:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:26 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:26 user nova-compute[75342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:05:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[06288ba8-ec7d-4a07-a72e-5f36bb104247]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:05:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibfAcHTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:05:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:05:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23963623030383966', 'path': '/dev/sdc'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:05:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963623030383966', 'path': '/dev/sdc'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:05:27 user nova-compute[75342]: DEBUG nova.objects.instance [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'flavor' on Instance uuid 28eaadcb-3f00-4868-8115-b5d4ba9454f3 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:05:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:05:27 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:05:27 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:05:27 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:05:27 user nova-compute[75342]:   <serial>e04bcbb1-af36-4770-8307-c95ec0dc26be</serial>
Nov 16 18:05:27 user nova-compute[75342]: </disk>
Nov 16 18:05:27 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:05:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:05:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:05:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No VIF found with MAC fa:16:3e:3c:3d:18, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:05:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-571b574c-f4aa-4a12-bbb2-660f071ae09c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.528s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:29 user nova-compute[75342]: INFO nova.compute.manager [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Rebuilding instance
Nov 16 18:05:29 user nova-compute[75342]: DEBUG nova.compute.manager [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:05:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-be313733-a74e-40c8-8dd2-4e19383ac9f2 req-8f338b98-039a-4dbc-9db1-d2957779b3f5 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-vif-unplugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be313733-a74e-40c8-8dd2-4e19383ac9f2 req-8f338b98-039a-4dbc-9db1-d2957779b3f5 service nova] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be313733-a74e-40c8-8dd2-4e19383ac9f2 req-8f338b98-039a-4dbc-9db1-d2957779b3f5 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-be313733-a74e-40c8-8dd2-4e19383ac9f2 req-8f338b98-039a-4dbc-9db1-d2957779b3f5 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-be313733-a74e-40c8-8dd2-4e19383ac9f2 req-8f338b98-039a-4dbc-9db1-d2957779b3f5 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] No waiting events found dispatching network-vif-unplugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:29 user nova-compute[75342]: WARNING nova.compute.manager [req-be313733-a74e-40c8-8dd2-4e19383ac9f2 req-8f338b98-039a-4dbc-9db1-d2957779b3f5 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received unexpected event network-vif-unplugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 for instance with vm_state active and task_state rebuilding.
Nov 16 18:05:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:30 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Instance destroyed successfully.
Nov 16 18:05:30 user nova-compute[75342]: INFO nova.compute.manager [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Detaching volume e04bcbb1-af36-4770-8307-c95ec0dc26be
Nov 16 18:05:30 user nova-compute[75342]: INFO nova.virt.block_device [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Attempting to driver detach volume e04bcbb1-af36-4770-8307-c95ec0dc26be from mountpoint /dev/vdb
Nov 16 18:05:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Attempting to detach device vdb from instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:05:30 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:05:30 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:05:30 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:05:30 user nova-compute[75342]:   <serial>e04bcbb1-af36-4770-8307-c95ec0dc26be</serial>
Nov 16 18:05:30 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:05:30 user nova-compute[75342]: </disk>
Nov 16 18:05:30 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:05:30 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully detached device vdb from instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 from the persistent domain config.
Nov 16 18:05:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibfAcHTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:05:30 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df3191b-3ecb-4bf7-b66f-534008269e30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:05:30 user nova-compute[75342]: No targets found.
Nov 16 18:05:30 user nova-compute[75342]: iSNS:
Nov 16 18:05:30 user nova-compute[75342]: No targets found.
Nov 16 18:05:30 user nova-compute[75342]: STATIC:
Nov 16 18:05:30 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be
Nov 16 18:05:30 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:05:30 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:05:30 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd
Nov 16 18:05:30 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:05:30 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:05:30 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:05:30 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:05:30 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:05:30 user nova-compute[75342]: FIRMWARE:
Nov 16 18:05:30 user nova-compute[75342]: No targets found.
Nov 16 18:05:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:05:30 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:05:30 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[490d5b39-b373-44fc-8788-9b0f412c3801]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecbba94-b006-4368-b28e-a4e2552d2d40]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:30 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:30 user nova-compute[75342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:05:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:30 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:30 user nova-compute[75342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:05:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c818add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be'): ({'sdc'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Removing single pathed devices sdc {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2605e645-0f87-4d94-a449-a5fe5a6cf8bd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3d89b3-26b5-4518-ae56-b0cd59aca88a]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flushing IO for device /dev/sdc {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[836ffc41-b2da-4d35-9f0f-57912e80497d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc57700-4d52-4d25-9624-c959926e0c29]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1647b031-4d5b-4094-b36d-d4fd5d60350f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc7de2b-17ff-4660-b31b-19ac2c96501f]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260]
Nov 16 18:05:30 user nova-compute[75342]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260] successful.
Nov 16 18:05:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b264b467-5742-4182-892f-e43f6b0dd921]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== disconnect_volume: return (328ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:05:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 18:05:31 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Instance destroyed successfully.
Nov 16 18:05:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-887107635',display_name='tempest-ServerActionsTestOtherA-server-1533163224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-887107635',id=17,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfwGnGzjoPuBYsLqsfQN6FM2vWnqcustRrTtZq3OicWLSB8yxCZthWTbl8eXWTXVUw2kpzZCI19a2sTDkWmNjVlQEF1Pk/zLU8VOzU8Glz1gUKzzWAUC1g4Kb4M6bYDqQ==',key_name='tempest-keypair-1194151370',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:03:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-8109rq0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:05:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=28eaadcb-3f00-4868-8115-b5d4ba9454f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_vif [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf10735e2-a2, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e71ff046-638a-4770-b3cd-272a5460e777) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:31 user nova-compute[75342]: INFO os_vif [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2')
Nov 16 18:05:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibfAcHTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:05:31 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-021a81d5-a74c-407c-9abf-c1a79e1bb70f req-fbe08e0c-370e-42dd-8bc6-6dd17f60ebf4 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-021a81d5-a74c-407c-9abf-c1a79e1bb70f req-fbe08e0c-370e-42dd-8bc6-6dd17f60ebf4 service nova] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-021a81d5-a74c-407c-9abf-c1a79e1bb70f req-fbe08e0c-370e-42dd-8bc6-6dd17f60ebf4 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-021a81d5-a74c-407c-9abf-c1a79e1bb70f req-fbe08e0c-370e-42dd-8bc6-6dd17f60ebf4 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-021a81d5-a74c-407c-9abf-c1a79e1bb70f req-fbe08e0c-370e-42dd-8bc6-6dd17f60ebf4 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] No waiting events found dispatching network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:31 user nova-compute[75342]: WARNING nova.compute.manager [req-021a81d5-a74c-407c-9abf-c1a79e1bb70f req-fbe08e0c-370e-42dd-8bc6-6dd17f60ebf4 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received unexpected event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 for instance with vm_state active and task_state rebuilding.
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b6bdbd-aaa3-442a-bd9b-773311c1f76d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:05:31 user nova-compute[75342]: No targets found.
Nov 16 18:05:31 user nova-compute[75342]: iSNS:
Nov 16 18:05:31 user nova-compute[75342]: No targets found.
Nov 16 18:05:31 user nova-compute[75342]: STATIC:
Nov 16 18:05:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd
Nov 16 18:05:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:05:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:05:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:05:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:05:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:05:31 user nova-compute[75342]: FIRMWARE:
Nov 16 18:05:31 user nova-compute[75342]: No targets found.
Nov 16 18:05:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:05:31 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:05:31 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df2fa54-c9be-45f5-9b49-a67b8d54d2b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb69d3e-a167-4b2e-a0b2-1f33565a2327]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:31 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:31 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a468c1f0>, {}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Disconnecting from: [] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== disconnect_volume: return (77ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:05:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:05:31 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Deleting instance files /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3_del
Nov 16 18:05:31 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Deletion of /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3_del complete
Nov 16 18:05:31 user nova-compute[75342]: INFO nova.virt.block_device [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Booting with volume e04bcbb1-af36-4770-8307-c95ec0dc26be at /dev/vdb
Nov 16 18:05:32 user nova-compute[75342]: DEBUG os_brick.utils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0576af7b-95c4-4dc0-86e8-6b15ba47bd84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f97861-9556-496d-a29d-35921869ba9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a48f76e-5fd4-4065-9ca8-8d715713c563]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3370057-91dc-4f50-8f2e-984160551112]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:05:32 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6814efa0-c139-42ff-bae3-2da6849a100e]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG os_brick.utils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Updating existing volume attachment record: 4b2d709f-e7a5-4d87-a0de-aaf0d5210192 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:32 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:33 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:33 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:34 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:05:35 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:35 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:05:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:05:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Port b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf binding to destination host user is already ACTIVE {{(pid=75342) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquired lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating instance_info_cache with network_info: [{"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Releasing lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:05:38 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Creating image(s)
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "/opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "/opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "/opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Creating tmpfile /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/tmpue3p402m to verify with other compute node that the instance is on the same shared storage. {{(pid=75342) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.216s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.206s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk 1073741824" returned: 0 in 0.056s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.219s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance destroyed successfully.
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lazy-loading 'resources' on Instance uuid 2992b5fc-86e6-425f-82e5-cf6358582872 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1606614034',display_name='tempest-ServerActionsTestOtherB-server-1606614034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1606614034',id=4,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1UyBGifbaRVIIusr59UKLEcXLfyd6epVSgRuItUg0lc3AijdYFqlIZoLMbi5dO5JpMBiHIhBKHMDap+u4RdhUKBD/7ZLtWgtZhiB+iJEQy+7uabGfTLiM4pLG8U3m+Tg==',key_name='tempest-keypair-290385198',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:04:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f427ee24cf34d538c1b2ae19266b9f3',ramdisk_id='',reservation_id='r-v0hi3c4d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-613458522',owner_user_name='tempest-ServerActionsTestOtherB-613458522-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:04:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67704d03b80e4d709863960014fbcd24',uuid=2992b5fc-86e6-425f-82e5-cf6358582872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converting VIF {"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_vif [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2a1cbd5-36, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Cannot resize image /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Ensure instance console log exists: /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Start _get_guest_xml network_info=[{"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4b2d709f-e7a5-4d87-a0de-aaf0d5210192', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibfAcHTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28eaadcb-3f00-4868-8115-b5d4ba9454f3', 'attached_at': '', 'detached_at': '', 'volume_id': 'e04bcbb1-af36-4770-8307-c95ec0dc26be', 'serial': 'e04bcbb1-af36-4770-8307-c95ec0dc26be'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0cf1f0a-53c9-4ca8-8638-569df60a6b65) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:39 user nova-compute[75342]: INFO os_vif [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36')
Nov 16 18:05:39 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 18:05:39 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrZWgwTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:05:39 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'vcpu_model' on Instance uuid 28eaadcb-3f00-4868-8115-b5d4ba9454f3 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4c61c5-baaf-4812-a087-ba9b57339c55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:05:39 user nova-compute[75342]: No targets found.
Nov 16 18:05:39 user nova-compute[75342]: iSNS:
Nov 16 18:05:39 user nova-compute[75342]: No targets found.
Nov 16 18:05:39 user nova-compute[75342]: STATIC:
Nov 16 18:05:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd
Nov 16 18:05:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:05:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:05:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:05:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:05:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:05:39 user nova-compute[75342]: FIRMWARE:
Nov 16 18:05:39 user nova-compute[75342]: No targets found.
Nov 16 18:05:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:05:39 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:05:39 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibfAcHTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:05:39 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b64d5a-cf66-4153-bfce-23300aad2c1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a96fa55-ca7a-4d2b-98e3-b37fcc8d25d4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:39 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:39 user nova-compute[75342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4561e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:05:39 user nova-compute[75342]: INFO nova.compute.manager [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Terminating instance
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG nova.compute.manager [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a28bf6-92f7-4652-9683-1dffebf78c50]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[601d71f5-85c6-4f76-bb0c-09efc97cebaa]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b231bf4-814e-4553-bb77-331cf67718dc]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[211e4daf-b469-4485-8a44-c46243589571]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8174d8f1-dd16-4f04-8510-97dd94efcd4a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5377842c-5086-4d7b-bb73-f068c29c1085]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]
Nov 16 18:05:40 user nova-compute[75342]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.
Nov 16 18:05:40 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f186d91a-56b4-444a-af0a-d9038184c624]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.696s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] <== disconnect_volume: return (697ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.631s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:05:40 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 18:05:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:05:40 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cae6e37-5465-4280-a26f-e0bc99be2d72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:05:40 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9836c7-4f45-4ef3-a4c5-31bf263c732f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be] added
Nov 16 18:05:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-d1f4c638-36d1-42ce-8a12-13c9d8977640 req-66773a27-b6a0-45d9-9780-326a591bec35 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Received event network-vif-unplugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d1f4c638-36d1-42ce-8a12-13c9d8977640 req-66773a27-b6a0-45d9-9780-326a591bec35 service nova] Acquiring lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d1f4c638-36d1-42ce-8a12-13c9d8977640 req-66773a27-b6a0-45d9-9780-326a591bec35 service nova] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d1f4c638-36d1-42ce-8a12-13c9d8977640 req-66773a27-b6a0-45d9-9780-326a591bec35 service nova] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-d1f4c638-36d1-42ce-8a12-13c9d8977640 req-66773a27-b6a0-45d9-9780-326a591bec35 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] No waiting events found dispatching network-vif-unplugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-d1f4c638-36d1-42ce-8a12-13c9d8977640 req-66773a27-b6a0-45d9-9780-326a591bec35 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Received event network-vif-unplugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:41 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:05:41 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7173MB free_disk=25.306724548339844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:41 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Instance destroyed successfully.
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lazy-loading 'resources' on Instance uuid edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0f2218-84ad-4344-b05c-781cead9fc26]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1849285264',display_name='tempest-VolumesAdminNegativeTest-server-1849285264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1849285264',id=5,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrr5gp0zj9mZttbh8lJ4OVyu1SE8E6Tt+zTD43bVLjSQj+T7orVvgEM1C/qlfNR4COwu3piUubjvVI+cxLee3F813lYnvLK+tP+6nPsfSdR5x5UoTm1fEK+z4AHSuvUxw==',key_name='tempest-keypair-1748820997',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d1f044ccaee41cfa073d66a26578f3d',ramdisk_id='',reservation_id='r-026ugqot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2111670408',owner_user_name='tempest-VolumesAdminNegativeTest-2111670408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21531e56db949a0a0a30925635a35d4',uuid=edfbe94c-988d-4fe3-a7d0-450ba54bf2c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converting VIF {"id": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "address": "fa:16:3e:3c:a8:f7", "network": {"id": "0ad85cef-e126-4de6-8ea4-4159de67f1c7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1480648262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d1f044ccaee41cfa073d66a26578f3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4cd90d-4d", "ovs_interfaceid": "8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:a8:f7,bridge_name='br-int',has_traffic_filtering=True,id=8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4cd90d-4d') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_vif [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:a8:f7,bridge_name='br-int',has_traffic_filtering=True,id=8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4cd90d-4d') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec904f2-e74a-4af9-9c4f-23f57f398980]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d4cd90d-4d, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibfAcHTO {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f78ec149-66e7-4c41-b46e-2dfed74d76da) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:41 user nova-compute[75342]: INFO os_vif [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:a8:f7,bridge_name='br-int',has_traffic_filtering=True,id=8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754,network=Network(0ad85cef-e126-4de6-8ea4-4159de67f1c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4cd90d-4d')
Nov 16 18:05:41 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Deleting instance files /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5_del
Nov 16 18:05:41 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Deletion of /opt/stack/data/nova/instances/edfbe94c-988d-4fe3-a7d0-450ba54bf2c5_del complete
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibfAcHTO" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5931adbd-543f-4c5d-9cba-99a16c28116c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ibfAcHTO'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[136939c5-3e3d-4189-a766-2887387ec5f5]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Applying migration context for instance 2992b5fc-86e6-425f-82e5-cf6358582872 as it has an incoming, in-progress migration b36afc8d-d0e3-4613-9dd5-227b0080649d. Migration status is reverting {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 18:05:41 user nova-compute[75342]: INFO nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating resource usage from migration b36afc8d-d0e3-4613-9dd5-227b0080649d
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11a06a6-7cf6-485f-9497-cb52256a7f97]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:41 user nova-compute[75342]: INFO nova.compute.manager [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6022562c-cc5f-4948-aec4-bba42abd9e55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260]
Nov 16 18:05:41 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260] successful.
Nov 16 18:05:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b563a24-5266-464b-8597-4e3b2f958111]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d758ed43-a051-41ae-b1ff-74a7a0ec987a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:41 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:05:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:41 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:05:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.021s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c49466-52a9-49b3-8379-8813582075cd]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Migration b36afc8d-d0e3-4613-9dd5-227b0080649d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 2992b5fc-86e6-425f-82e5-cf6358582872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c6408c85-ed86-4b11-afa6-14f93b92492c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance fb00d09d-d7c3-43f8-a118-26868011460b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 8b5474bd-3446-452a-adb4-63138de26b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing inventories for resource provider fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating ProviderTree inventory for provider fdd6b940-75a0-4315-8416-79157aaeea59 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing aggregate associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, aggregates: None {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-7b482249-f4f5-4cdc-8a4e-a2f22d30f28f req-63701ea9-4d9b-486b-8bd4-5a83bf4b98bd service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-unplugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7b482249-f4f5-4cdc-8a4e-a2f22d30f28f req-63701ea9-4d9b-486b-8bd4-5a83bf4b98bd service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7b482249-f4f5-4cdc-8a4e-a2f22d30f28f req-63701ea9-4d9b-486b-8bd4-5a83bf4b98bd service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7b482249-f4f5-4cdc-8a4e-a2f22d30f28f req-63701ea9-4d9b-486b-8bd4-5a83bf4b98bd service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-7b482249-f4f5-4cdc-8a4e-a2f22d30f28f req-63701ea9-4d9b-486b-8bd4-5a83bf4b98bd service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-unplugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:41 user nova-compute[75342]: WARNING nova.compute.manager [req-7b482249-f4f5-4cdc-8a4e-a2f22d30f28f req-63701ea9-4d9b-486b-8bd4-5a83bf4b98bd service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received unexpected event network-vif-unplugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with vm_state resized and task_state resize_reverting.
Nov 16 18:05:41 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing trait associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, traits: COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.293s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.263s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] There are 0 instances to clean {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lazy-loading 'migration_context' on Instance uuid 2992b5fc-86e6-425f-82e5-cf6358582872 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibfAcHTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.074s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== connect_volume: return (2705ms) {'type': 'block', 'scsi_wwn': '23963623030383966', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963623030383966', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.objects.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Object Instance<2992b5fc-86e6-425f-82e5-cf6358582872> lazy-loaded attributes: resources,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-887107635',display_name='tempest-ServerActionsTestOtherA-server-1533163224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-887107635',id=17,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfwGnGzjoPuBYsLqsfQN6FM2vWnqcustRrTtZq3OicWLSB8yxCZthWTbl8eXWTXVUw2kpzZCI19a2sTDkWmNjVlQEF1Pk/zLU8VOzU8Glz1gUKzzWAUC1g4Kb4M6bYDqQ==',key_name='tempest-keypair-1194151370',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:03:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-8109rq0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=28eaadcb-3f00-4868-8115-b5d4ba9454f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:05:42 user nova-compute[75342]:   <uuid>28eaadcb-3f00-4868-8115-b5d4ba9454f3</uuid>
Nov 16 18:05:42 user nova-compute[75342]:   <name>instance-00000011</name>
Nov 16 18:05:42 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:05:42 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:05:42 user nova-compute[75342]:   <metadata>
Nov 16 18:05:42 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:05:42 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:05:42 user nova-compute[75342]:       <nova:name>tempest-ServerActionsTestOtherA-server-1533163224</nova:name>
Nov 16 18:05:42 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:05:39</nova:creationTime>
Nov 16 18:05:42 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:05:42 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:05:42 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:05:42 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:05:42 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:05:42 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:05:42 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:05:42 user nova-compute[75342]:       <nova:owner>
Nov 16 18:05:42 user nova-compute[75342]:         <nova:user uuid="1794b9bef4ad42e6aab088f3ef90dba2">tempest-ServerActionsTestOtherA-1650562087-project-member</nova:user>
Nov 16 18:05:42 user nova-compute[75342]:         <nova:project uuid="c78cae892fff433eb216caff3a127a64">tempest-ServerActionsTestOtherA-1650562087</nova:project>
Nov 16 18:05:42 user nova-compute[75342]:       </nova:owner>
Nov 16 18:05:42 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:05:42 user nova-compute[75342]:       <nova:ports>
Nov 16 18:05:42 user nova-compute[75342]:         <nova:port uuid="f10735e2-a261-4be2-9fc4-2ae2622116b1">
Nov 16 18:05:42 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 18:05:42 user nova-compute[75342]:         </nova:port>
Nov 16 18:05:42 user nova-compute[75342]:       </nova:ports>
Nov 16 18:05:42 user nova-compute[75342]:     </nova:instance>
Nov 16 18:05:42 user nova-compute[75342]:   </metadata>
Nov 16 18:05:42 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:05:42 user nova-compute[75342]:     <system>
Nov 16 18:05:42 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:05:42 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:05:42 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:05:42 user nova-compute[75342]:       <entry name="serial">28eaadcb-3f00-4868-8115-b5d4ba9454f3</entry>
Nov 16 18:05:42 user nova-compute[75342]:       <entry name="uuid">28eaadcb-3f00-4868-8115-b5d4ba9454f3</entry>
Nov 16 18:05:42 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:05:42 user nova-compute[75342]:     </system>
Nov 16 18:05:42 user nova-compute[75342]:   </sysinfo>
Nov 16 18:05:42 user nova-compute[75342]:   <os>
Nov 16 18:05:42 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:05:42 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:05:42 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:05:42 user nova-compute[75342]:   </os>
Nov 16 18:05:42 user nova-compute[75342]:   <features>
Nov 16 18:05:42 user nova-compute[75342]:     <acpi/>
Nov 16 18:05:42 user nova-compute[75342]:     <apic/>
Nov 16 18:05:42 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:05:42 user nova-compute[75342]:   </features>
Nov 16 18:05:42 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:05:42 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:05:42 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:05:42 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:05:42 user nova-compute[75342]:   </clock>
Nov 16 18:05:42 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:05:42 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:05:42 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:05:42 user nova-compute[75342]:   </cpu>
Nov 16 18:05:42 user nova-compute[75342]:   <devices>
Nov 16 18:05:42 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:05:42 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:05:42 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk"/>
Nov 16 18:05:42 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:05:42 user nova-compute[75342]:     </disk>
Nov 16 18:05:42 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:05:42 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:05:42 user nova-compute[75342]:       <source dev="/dev/sdb"/>
Nov 16 18:05:42 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:05:42 user nova-compute[75342]:       <serial>e04bcbb1-af36-4770-8307-c95ec0dc26be</serial>
Nov 16 18:05:42 user nova-compute[75342]:     </disk>
Nov 16 18:05:42 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:05:42 user nova-compute[75342]:       <mac address="fa:16:3e:3c:3d:18"/>
Nov 16 18:05:42 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:05:42 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:05:42 user nova-compute[75342]:       <target dev="tapf10735e2-a2"/>
Nov 16 18:05:42 user nova-compute[75342]:     </interface>
Nov 16 18:05:42 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:05:42 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/console.log" append="off"/>
Nov 16 18:05:42 user nova-compute[75342]:     </serial>
Nov 16 18:05:42 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:05:42 user nova-compute[75342]:     <video>
Nov 16 18:05:42 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:05:42 user nova-compute[75342]:     </video>
Nov 16 18:05:42 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:05:42 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:05:42 user nova-compute[75342]:     </rng>
Nov 16 18:05:42 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:05:42 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:05:42 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:05:42 user nova-compute[75342]:     </memballoon>
Nov 16 18:05:42 user nova-compute[75342]:   </devices>
Nov 16 18:05:42 user nova-compute[75342]: </domain>
Nov 16 18:05:42 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-887107635',display_name='tempest-ServerActionsTestOtherA-server-1533163224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-887107635',id=17,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfwGnGzjoPuBYsLqsfQN6FM2vWnqcustRrTtZq3OicWLSB8yxCZthWTbl8eXWTXVUw2kpzZCI19a2sTDkWmNjVlQEF1Pk/zLU8VOzU8Glz1gUKzzWAUC1g4Kb4M6bYDqQ==',key_name='tempest-keypair-1194151370',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:03:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-8109rq0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=28eaadcb-3f00-4868-8115-b5d4ba9454f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG os_vif [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dce3653-527f-59c2-ad62-8176dd3bb57e', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf10735e2-a2, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf10735e2-a2, col_values=(('qos', UUID('05b8fe6b-4cd0-4b84-bfb5-f3ae57916127')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf10735e2-a2, col_values=(('external_ids', {'iface-id': 'f10735e2-a261-4be2-9fc4-2ae2622116b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:3d:18', 'vm-uuid': '28eaadcb-3f00-4868-8115-b5d4ba9454f3'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:42 user nova-compute[75342]: INFO os_vif [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2')
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No VIF found with MAC fa:16:3e:3c:3d:18, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-07601587-ffbe-4341-ac99-a9696fbe892c req-5de4e972-5c0a-4576-9d13-7fb146868f00 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Received event network-vif-plugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-07601587-ffbe-4341-ac99-a9696fbe892c req-5de4e972-5c0a-4576-9d13-7fb146868f00 service nova] Acquiring lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-07601587-ffbe-4341-ac99-a9696fbe892c req-5de4e972-5c0a-4576-9d13-7fb146868f00 service nova] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-07601587-ffbe-4341-ac99-a9696fbe892c req-5de4e972-5c0a-4576-9d13-7fb146868f00 service nova] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-07601587-ffbe-4341-ac99-a9696fbe892c req-5de4e972-5c0a-4576-9d13-7fb146868f00 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] No waiting events found dispatching network-vif-plugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:42 user nova-compute[75342]: WARNING nova.compute.manager [req-07601587-ffbe-4341-ac99-a9696fbe892c req-5de4e972-5c0a-4576-9d13-7fb146868f00 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Received unexpected event network-vif-plugged-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 for instance with vm_state active and task_state deleting.
Nov 16 18:05:42 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.706s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:05:43 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Took 1.99 seconds to deallocate network for instance.
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:05:43 user nova-compute[75342]: INFO nova.compute.claims [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Claim successful on node user
Nov 16 18:05:43 user nova-compute[75342]: INFO nova.compute.manager [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Swapping old allocation on dict_keys(['fdd6b940-75a0-4315-8416-79157aaeea59']) held by migration b36afc8d-d0e3-4613-9dd5-227b0080649d for instance
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Overwriting current allocation {'allocations': {'fdd6b940-75a0-4315-8416-79157aaeea59': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': '2f427ee24cf34d538c1b2ae19266b9f3', 'user_id': '67704d03b80e4d709863960014fbcd24', 'consumer_generation': 1} on consumer 2992b5fc-86e6-425f-82e5-cf6358582872 {{(pid=75342) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquired lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:05:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.668s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.network.neutron [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:05:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.policy [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '520c2ec376be46aaabcc5ca1c7aa831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c366b0f382394d26a46a902606d1b860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-86492969-fde8-4333-930b-6ffda1b9c983 req-d1da262d-0ec8-4ccf-9837-65e0fe8778c3 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-86492969-fde8-4333-930b-6ffda1b9c983 req-d1da262d-0ec8-4ccf-9837-65e0fe8778c3 service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-86492969-fde8-4333-930b-6ffda1b9c983 req-d1da262d-0ec8-4ccf-9837-65e0fe8778c3 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-86492969-fde8-4333-930b-6ffda1b9c983 req-d1da262d-0ec8-4ccf-9837-65e0fe8778c3 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-86492969-fde8-4333-930b-6ffda1b9c983 req-d1da262d-0ec8-4ccf-9837-65e0fe8778c3 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:44 user nova-compute[75342]: WARNING nova.compute.manager [req-86492969-fde8-4333-930b-6ffda1b9c983 req-d1da262d-0ec8-4ccf-9837-65e0fe8778c3 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received unexpected event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with vm_state resized and task_state resize_reverting.
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-86492969-fde8-4333-930b-6ffda1b9c983 req-d1da262d-0ec8-4ccf-9837-65e0fe8778c3 service nova] [instance: edfbe94c-988d-4fe3-a7d0-450ba54bf2c5] Received event network-vif-deleted-8d4cd90d-4dfc-4c52-a3bf-0f9b1779e754 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:05:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Creating image(s)
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "/opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "/opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "/opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating instance_info_cache with network_info: [{"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-847edcb6-4e1a-4277-bba4-f8ee5ca96103 req-003ff472-8539-4d7e-9326-4e1a30b447fb service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-847edcb6-4e1a-4277-bba4-f8ee5ca96103 req-003ff472-8539-4d7e-9326-4e1a30b447fb service nova] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-847edcb6-4e1a-4277-bba4-f8ee5ca96103 req-003ff472-8539-4d7e-9326-4e1a30b447fb service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-847edcb6-4e1a-4277-bba4-f8ee5ca96103 req-003ff472-8539-4d7e-9326-4e1a30b447fb service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-847edcb6-4e1a-4277-bba4-f8ee5ca96103 req-003ff472-8539-4d7e-9326-4e1a30b447fb service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] No waiting events found dispatching network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:44 user nova-compute[75342]: WARNING nova.compute.manager [req-847edcb6-4e1a-4277-bba4-f8ee5ca96103 req-003ff472-8539-4d7e-9326-4e1a30b447fb service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received unexpected event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 18:05:44 user nova-compute[75342]: WARNING nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] While synchronizing instance power states, found 12 instances in the database and 9 instances on the hypervisor.
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 85cd3e12-187f-48ba-9753-e8e93787cdf4 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 0c54066f-8fa7-4279-b62e-64614b01d6b1 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 2992b5fc-86e6-425f-82e5-cf6358582872 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 78afab8c-3e7c-4697-86b8-726c6ed252c5 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid d0385123-12ff-41a3-a78d-ac5ce325ae0d {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid c6408c85-ed86-4b11-afa6-14f93b92492c {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 8b5474bd-3446-452a-adb4-63138de26b3d {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid c35a34d1-db34-4e60-ac54-cb22aa1a9079 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid edfbe94c-988d-4fe3-a7d0-450ba54bf2c5 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 28eaadcb-3f00-4868-8115-b5d4ba9454f3 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "2992b5fc-86e6-425f-82e5-cf6358582872" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: INFO nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "2992b5fc-86e6-425f-82e5-cf6358582872" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "c6408c85-ed86-4b11-afa6-14f93b92492c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "8b5474bd-3446-452a-adb4-63138de26b3d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "8b5474bd-3446-452a-adb4-63138de26b3d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: INFO nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Releasing lock "refresh_cache-2992b5fc-86e6-425f-82e5-cf6358582872" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG os_brick.utils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9bfce2-eca1-4732-825c-298b380b9d4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e5582a-dc42-4e10-b9aa-3f4adf7afc43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7419f84c-a0a1-4000-a8ec-d306daaad1df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fbbad8-6832-4540-8bad-2269425cd9a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.193s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.196s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.206s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.200s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.198s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "8b5474bd-3446-452a-adb4-63138de26b3d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.198s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.317s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:05:44 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4f09a8-f26a-482d-a58b-e02824c7cc3e]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG os_brick.utils [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] <== get_connector_properties: return (257ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.936s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.201s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:45 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Deleted allocations for instance edfbe94c-988d-4fe3-a7d0-450ba54bf2c5
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk 1073741824" returned: 0 in 0.068s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Successfully created port: 89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f8be42e7-82ff-466c-af89-f40a705adc94 tempest-VolumesAdminNegativeTest-2111670408 tempest-VolumesAdminNegativeTest-2111670408-project-member] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.344s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.582s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "edfbe94c-988d-4fe3-a7d0-450ba54bf2c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.217s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Cannot resize image /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Ensure instance console log exists: /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Successfully updated port: 89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "refresh_cache-c35a34d1-db34-4e60-ac54-cb22aa1a9079" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquired lock "refresh_cache-c35a34d1-db34-4e60-ac54-cb22aa1a9079" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.compute.manager [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:05:46 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Instance spawned successfully.
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.compute.manager [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] No waiting events found dispatching network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:46 user nova-compute[75342]: WARNING nova.compute.manager [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received unexpected event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Received event network-changed-89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Refreshing instance network info cache due to event network-changed-89dc167c-d215-4c26-84ca-f96fb075a578. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] Acquiring lock "refresh_cache-c35a34d1-db34-4e60-ac54-cb22aa1a9079" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG nova.objects.instance [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75342) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 18:05:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-75e1d08b-7914-4cbe-9080-6d6b3bd35091 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.159s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Updating instance_info_cache with network_info: [{"id": "89dc167c-d215-4c26-84ca-f96fb075a578", "address": "fa:16:3e:5d:53:cf", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc167c-d2", "ovs_interfaceid": "89dc167c-d215-4c26-84ca-f96fb075a578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Releasing lock "refresh_cache-c35a34d1-db34-4e60-ac54-cb22aa1a9079" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Instance network_info: |[{"id": "89dc167c-d215-4c26-84ca-f96fb075a578", "address": "fa:16:3e:5d:53:cf", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc167c-d2", "ovs_interfaceid": "89dc167c-d215-4c26-84ca-f96fb075a578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] Acquired lock "refresh_cache-c35a34d1-db34-4e60-ac54-cb22aa1a9079" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.network.neutron [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Refreshing network info cache for port 89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Start _get_guest_xml network_info=[{"id": "89dc167c-d215-4c26-84ca-f96fb075a578", "address": "fa:16:3e:5d:53:cf", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc167c-d2", "ovs_interfaceid": "89dc167c-d215-4c26-84ca-f96fb075a578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:05:47 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:05:47 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-301313553',display_name='tempest-ServersNegativeTestJSON-server-301313553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-301313553',id=21,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c366b0f382394d26a46a902606d1b860',ramdisk_id='',reservation_id='r-42jo5nml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1517580992',owner_user_name='tempest-ServersNegativeTestJSON-1517580992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:05:44Z,user_data=None,user_id='520c2ec376be46aaabcc5ca1c7aa831c',uuid=c35a34d1-db34-4e60-ac54-cb22aa1a9079,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89dc167c-d215-4c26-84ca-f96fb075a578", "address": "fa:16:3e:5d:53:cf", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc167c-d2", "ovs_interfaceid": "89dc167c-d215-4c26-84ca-f96fb075a578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converting VIF {"id": "89dc167c-d215-4c26-84ca-f96fb075a578", "address": "fa:16:3e:5d:53:cf", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc167c-d2", "ovs_interfaceid": "89dc167c-d215-4c26-84ca-f96fb075a578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:53:cf,bridge_name='br-int',has_traffic_filtering=True,id=89dc167c-d215-4c26-84ca-f96fb075a578,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc167c-d2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lazy-loading 'pci_devices' on Instance uuid c35a34d1-db34-4e60-ac54-cb22aa1a9079 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:05:47 user nova-compute[75342]:   <uuid>c35a34d1-db34-4e60-ac54-cb22aa1a9079</uuid>
Nov 16 18:05:47 user nova-compute[75342]:   <name>instance-00000015</name>
Nov 16 18:05:47 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:05:47 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:05:47 user nova-compute[75342]:   <metadata>
Nov 16 18:05:47 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:05:47 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:05:47 user nova-compute[75342]:       <nova:name>tempest-ServersNegativeTestJSON-server-301313553</nova:name>
Nov 16 18:05:47 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:05:47</nova:creationTime>
Nov 16 18:05:47 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:05:47 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:05:47 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:05:47 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:05:47 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:05:47 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:05:47 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:05:47 user nova-compute[75342]:       <nova:owner>
Nov 16 18:05:47 user nova-compute[75342]:         <nova:user uuid="520c2ec376be46aaabcc5ca1c7aa831c">tempest-ServersNegativeTestJSON-1517580992-project-member</nova:user>
Nov 16 18:05:47 user nova-compute[75342]:         <nova:project uuid="c366b0f382394d26a46a902606d1b860">tempest-ServersNegativeTestJSON-1517580992</nova:project>
Nov 16 18:05:47 user nova-compute[75342]:       </nova:owner>
Nov 16 18:05:47 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:05:47 user nova-compute[75342]:       <nova:ports>
Nov 16 18:05:47 user nova-compute[75342]:         <nova:port uuid="89dc167c-d215-4c26-84ca-f96fb075a578">
Nov 16 18:05:47 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 18:05:47 user nova-compute[75342]:         </nova:port>
Nov 16 18:05:47 user nova-compute[75342]:       </nova:ports>
Nov 16 18:05:47 user nova-compute[75342]:     </nova:instance>
Nov 16 18:05:47 user nova-compute[75342]:   </metadata>
Nov 16 18:05:47 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:05:47 user nova-compute[75342]:     <system>
Nov 16 18:05:47 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:05:47 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:05:47 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:05:47 user nova-compute[75342]:       <entry name="serial">c35a34d1-db34-4e60-ac54-cb22aa1a9079</entry>
Nov 16 18:05:47 user nova-compute[75342]:       <entry name="uuid">c35a34d1-db34-4e60-ac54-cb22aa1a9079</entry>
Nov 16 18:05:47 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:05:47 user nova-compute[75342]:     </system>
Nov 16 18:05:47 user nova-compute[75342]:   </sysinfo>
Nov 16 18:05:47 user nova-compute[75342]:   <os>
Nov 16 18:05:47 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:05:47 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:05:47 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:05:47 user nova-compute[75342]:   </os>
Nov 16 18:05:47 user nova-compute[75342]:   <features>
Nov 16 18:05:47 user nova-compute[75342]:     <acpi/>
Nov 16 18:05:47 user nova-compute[75342]:     <apic/>
Nov 16 18:05:47 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:05:47 user nova-compute[75342]:   </features>
Nov 16 18:05:47 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:05:47 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:05:47 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:05:47 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:05:47 user nova-compute[75342]:   </clock>
Nov 16 18:05:47 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:05:47 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:05:47 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:05:47 user nova-compute[75342]:   </cpu>
Nov 16 18:05:47 user nova-compute[75342]:   <devices>
Nov 16 18:05:47 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:05:47 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:05:47 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk"/>
Nov 16 18:05:47 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:05:47 user nova-compute[75342]:     </disk>
Nov 16 18:05:47 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:05:47 user nova-compute[75342]:       <mac address="fa:16:3e:5d:53:cf"/>
Nov 16 18:05:47 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:05:47 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:05:47 user nova-compute[75342]:       <target dev="tap89dc167c-d2"/>
Nov 16 18:05:47 user nova-compute[75342]:     </interface>
Nov 16 18:05:47 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:05:47 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/console.log" append="off"/>
Nov 16 18:05:47 user nova-compute[75342]:     </serial>
Nov 16 18:05:47 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:05:47 user nova-compute[75342]:     <video>
Nov 16 18:05:47 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:05:47 user nova-compute[75342]:     </video>
Nov 16 18:05:47 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:05:47 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:05:47 user nova-compute[75342]:     </rng>
Nov 16 18:05:47 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:05:47 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:05:47 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:05:47 user nova-compute[75342]:     </memballoon>
Nov 16 18:05:47 user nova-compute[75342]:   </devices>
Nov 16 18:05:47 user nova-compute[75342]: </domain>
Nov 16 18:05:47 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-301313553',display_name='tempest-ServersNegativeTestJSON-server-301313553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-301313553',id=21,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c366b0f382394d26a46a902606d1b860',ramdisk_id='',reservation_id='r-42jo5nml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1517580992',owner_user_name='tempest-ServersNegativeTestJSON-1517580992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:05:44Z,user_data=None,user_id='520c2ec376be46aaabcc5ca1c7aa831c',uuid=c35a34d1-db34-4e60-ac54-cb22aa1a9079,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89dc167c-d215-4c26-84ca-f96fb075a578", "address": "fa:16:3e:5d:53:cf", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc167c-d2", "ovs_interfaceid": "89dc167c-d215-4c26-84ca-f96fb075a578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converting VIF {"id": "89dc167c-d215-4c26-84ca-f96fb075a578", "address": "fa:16:3e:5d:53:cf", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc167c-d2", "ovs_interfaceid": "89dc167c-d215-4c26-84ca-f96fb075a578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:53:cf,bridge_name='br-int',has_traffic_filtering=True,id=89dc167c-d215-4c26-84ca-f96fb075a578,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc167c-d2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG os_vif [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:53:cf,bridge_name='br-int',has_traffic_filtering=True,id=89dc167c-d215-4c26-84ca-f96fb075a578,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc167c-d2') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb803313-4549-5036-8d23-8f033ef436ac', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89dc167c-d2, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89dc167c-d2, col_values=(('qos', UUID('15a8abfd-83ba-48a5-8391-292d7f046818')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89dc167c-d2, col_values=(('external_ids', {'iface-id': '89dc167c-d215-4c26-84ca-f96fb075a578', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:53:cf', 'vm-uuid': 'c35a34d1-db34-4e60-ac54-cb22aa1a9079'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:47 user nova-compute[75342]: INFO os_vif [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:53:cf,bridge_name='br-int',has_traffic_filtering=True,id=89dc167c-d215-4c26-84ca-f96fb075a578,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc167c-d2')
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] No VIF found with MAC fa:16:3e:5d:53:cf, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.network.neutron [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Updated VIF entry in instance network info cache for port 89dc167c-d215-4c26-84ca-f96fb075a578. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.network.neutron [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Updating instance_info_cache with network_info: [{"id": "89dc167c-d215-4c26-84ca-f96fb075a578", "address": "fa:16:3e:5d:53:cf", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc167c-d2", "ovs_interfaceid": "89dc167c-d215-4c26-84ca-f96fb075a578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3b035337-7177-4791-890d-b593c822cf21 req-f1937b4c-833e-4514-ac1f-e2b6ad1918b8 service nova] Releasing lock "refresh_cache-c35a34d1-db34-4e60-ac54-cb22aa1a9079" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:47 user nova-compute[75342]: DEBUG nova.compute.manager [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:05:48 user nova-compute[75342]: INFO nova.compute.claims [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Claim successful on node user
Nov 16 18:05:48 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG nova.network.neutron [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:05:48 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:05:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:48 user nova-compute[75342]: DEBUG nova.policy [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31989b60047b497081580f6a7c0b7c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165c413794047efaea43b92a124f937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:05:49 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Creating image(s)
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "/opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "/opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "/opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-234f2bb9-da38-4acb-b76a-08d2e942effb req-1396b993-f598-479b-b0c4-cbc480de07ec service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Received event network-vif-plugged-89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-234f2bb9-da38-4acb-b76a-08d2e942effb req-1396b993-f598-479b-b0c4-cbc480de07ec service nova] Acquiring lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-234f2bb9-da38-4acb-b76a-08d2e942effb req-1396b993-f598-479b-b0c4-cbc480de07ec service nova] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-234f2bb9-da38-4acb-b76a-08d2e942effb req-1396b993-f598-479b-b0c4-cbc480de07ec service nova] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-234f2bb9-da38-4acb-b76a-08d2e942effb req-1396b993-f598-479b-b0c4-cbc480de07ec service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] No waiting events found dispatching network-vif-plugged-89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:49 user nova-compute[75342]: WARNING nova.compute.manager [req-234f2bb9-da38-4acb-b76a-08d2e942effb req-1396b993-f598-479b-b0c4-cbc480de07ec service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Received unexpected event network-vif-plugged-89dc167c-d215-4c26-84ca-f96fb075a578 for instance with vm_state building and task_state spawning.
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.201s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.203s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk 1073741824" returned: 0 in 0.058s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Successfully created port: 258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Cannot resize image /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Ensure instance console log exists: /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Successfully updated port: 258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "refresh_cache-218bd8cd-58a5-40b3-a989-5aea6a5c9c43" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquired lock "refresh_cache-218bd8cd-58a5-40b3-a989-5aea6a5c9c43" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-96eea8d6-dfea-4ca2-969e-be60dc811875 req-c41d4561-7f0c-44e6-b2ab-0e577a397227 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Received event network-changed-258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-96eea8d6-dfea-4ca2-969e-be60dc811875 req-c41d4561-7f0c-44e6-b2ab-0e577a397227 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Refreshing instance network info cache due to event network-changed-258320a2-30f7-4c04-bb9f-49a4caa90b3f. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-96eea8d6-dfea-4ca2-969e-be60dc811875 req-c41d4561-7f0c-44e6-b2ab-0e577a397227 service nova] Acquiring lock "refresh_cache-218bd8cd-58a5-40b3-a989-5aea6a5c9c43" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Starting finish_revert_migration {{(pid=75342) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Start _get_guest_xml network_info=[{"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a018459c-9c09-446a-b02d-9dc3bd27ac80', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrZWgwTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2992b5fc-86e6-425f-82e5-cf6358582872', 'attached_at': '2023-11-16T18:05:51.000000', 'detached_at': '', 'volume_id': 'a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'serial': 'a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:05:50 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:05:50 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:05:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2992b5fc-86e6-425f-82e5-cf6358582872 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrZWgwTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:05:51 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:05:51 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:05:51 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ad9682-5a6f-4553-91cc-d47174258ade]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:05:51 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9236a27-89f0-4f41-91e3-4deeb3062358]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd] added
Nov 16 18:05:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9d4b01-5350-4077-8d2b-36a7a5c7bd8c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.network.neutron [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Updating instance_info_cache with network_info: [{"id": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "address": "fa:16:3e:c5:f5:ba", "network": {"id": "84a047a1-f39f-4ca6-a9db-6cc532a1d632", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1681619625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d165c413794047efaea43b92a124f937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258320a2-30", "ovs_interfaceid": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7b1a51-f58d-48b4-9cf0-82d51f5c3214]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrZWgwTd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Releasing lock "refresh_cache-218bd8cd-58a5-40b3-a989-5aea6a5c9c43" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Instance network_info: |[{"id": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "address": "fa:16:3e:c5:f5:ba", "network": {"id": "84a047a1-f39f-4ca6-a9db-6cc532a1d632", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1681619625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d165c413794047efaea43b92a124f937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258320a2-30", "ovs_interfaceid": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-96eea8d6-dfea-4ca2-969e-be60dc811875 req-c41d4561-7f0c-44e6-b2ab-0e577a397227 service nova] Acquired lock "refresh_cache-218bd8cd-58a5-40b3-a989-5aea6a5c9c43" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-96eea8d6-dfea-4ca2-969e-be60dc811875 req-c41d4561-7f0c-44e6-b2ab-0e577a397227 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Refreshing network info cache for port 258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Start _get_guest_xml network_info=[{"id": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "address": "fa:16:3e:c5:f5:ba", "network": {"id": "84a047a1-f39f-4ca6-a9db-6cc532a1d632", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1681619625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d165c413794047efaea43b92a124f937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258320a2-30", "ovs_interfaceid": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrZWgwTd" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca59da6-6b8b-462e-990c-285959ddad51]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UrZWgwTd'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:05:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a66f03-cc7d-4f6f-b100-4eed572bc3b9]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-697398401',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-697398401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6973984',id=22,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcwx0Orjt6Ca/Yih36YeYLgaT1UomcNsrVSAhEP/MGM4Su8rNfSWoBkKLpkIFsLHmIXhU1pk0eSs1jdoPm+714n2rlaTIANmtnTlgUx+LV7qePuTEZcr+UgPFnw5xMmzw==',key_name='tempest-keypair-1136982146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d165c413794047efaea43b92a124f937',ramdisk_id='',reservation_id='r-8a46eqj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1722200781',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31989b60047b497081580f6a7c0b7c91',uuid=218bd8cd-58a5-40b3-a989-5aea6a5c9c43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "address": "fa:16:3e:c5:f5:ba", "network": {"id": "84a047a1-f39f-4ca6-a9db-6cc532a1d632", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1681619625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d165c413794047efaea43b92a124f937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258320a2-30", "ovs_interfaceid": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Converting VIF {"id": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "address": "fa:16:3e:c5:f5:ba", "network": {"id": "84a047a1-f39f-4ca6-a9db-6cc532a1d632", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1681619625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d165c413794047efaea43b92a124f937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258320a2-30", "ovs_interfaceid": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f5:ba,bridge_name='br-int',has_traffic_filtering=True,id=258320a2-30f7-4c04-bb9f-49a4caa90b3f,network=Network(84a047a1-f39f-4ca6-a9db-6cc532a1d632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258320a2-30') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lazy-loading 'pci_devices' on Instance uuid 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a71b7d-5f5e-4d5e-addf-1f4e47c27f6f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:51 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:05:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:51 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:05:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:05:51 user nova-compute[75342]:   <uuid>218bd8cd-58a5-40b3-a989-5aea6a5c9c43</uuid>
Nov 16 18:05:51 user nova-compute[75342]:   <name>instance-00000016</name>
Nov 16 18:05:51 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:05:51 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:05:51 user nova-compute[75342]:   <metadata>
Nov 16 18:05:51 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:05:51 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:05:51 user nova-compute[75342]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-697398401</nova:name>
Nov 16 18:05:51 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:05:51</nova:creationTime>
Nov 16 18:05:51 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:05:51 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:05:51 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:05:51 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:05:51 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:05:51 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:05:51 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:05:51 user nova-compute[75342]:       <nova:owner>
Nov 16 18:05:51 user nova-compute[75342]:         <nova:user uuid="31989b60047b497081580f6a7c0b7c91">tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member</nova:user>
Nov 16 18:05:51 user nova-compute[75342]:         <nova:project uuid="d165c413794047efaea43b92a124f937">tempest-TestServerVolumeAttachScenarioOldVersion-1722200781</nova:project>
Nov 16 18:05:51 user nova-compute[75342]:       </nova:owner>
Nov 16 18:05:51 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:05:51 user nova-compute[75342]:       <nova:ports>
Nov 16 18:05:51 user nova-compute[75342]:         <nova:port uuid="258320a2-30f7-4c04-bb9f-49a4caa90b3f">
Nov 16 18:05:51 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 18:05:51 user nova-compute[75342]:         </nova:port>
Nov 16 18:05:51 user nova-compute[75342]:       </nova:ports>
Nov 16 18:05:51 user nova-compute[75342]:     </nova:instance>
Nov 16 18:05:51 user nova-compute[75342]:   </metadata>
Nov 16 18:05:51 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:05:51 user nova-compute[75342]:     <system>
Nov 16 18:05:51 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:05:51 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:05:51 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:05:51 user nova-compute[75342]:       <entry name="serial">218bd8cd-58a5-40b3-a989-5aea6a5c9c43</entry>
Nov 16 18:05:51 user nova-compute[75342]:       <entry name="uuid">218bd8cd-58a5-40b3-a989-5aea6a5c9c43</entry>
Nov 16 18:05:51 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:05:51 user nova-compute[75342]:     </system>
Nov 16 18:05:51 user nova-compute[75342]:   </sysinfo>
Nov 16 18:05:51 user nova-compute[75342]:   <os>
Nov 16 18:05:51 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:05:51 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:05:51 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:05:51 user nova-compute[75342]:   </os>
Nov 16 18:05:51 user nova-compute[75342]:   <features>
Nov 16 18:05:51 user nova-compute[75342]:     <acpi/>
Nov 16 18:05:51 user nova-compute[75342]:     <apic/>
Nov 16 18:05:51 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:05:51 user nova-compute[75342]:   </features>
Nov 16 18:05:51 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:05:51 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:05:51 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:05:51 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:05:51 user nova-compute[75342]:   </clock>
Nov 16 18:05:51 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:05:51 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:05:51 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:05:51 user nova-compute[75342]:   </cpu>
Nov 16 18:05:51 user nova-compute[75342]:   <devices>
Nov 16 18:05:51 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:05:51 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:05:51 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk"/>
Nov 16 18:05:51 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:05:51 user nova-compute[75342]:     </disk>
Nov 16 18:05:51 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:05:51 user nova-compute[75342]:       <mac address="fa:16:3e:c5:f5:ba"/>
Nov 16 18:05:51 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:05:51 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:05:51 user nova-compute[75342]:       <target dev="tap258320a2-30"/>
Nov 16 18:05:51 user nova-compute[75342]:     </interface>
Nov 16 18:05:51 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:05:51 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/console.log" append="off"/>
Nov 16 18:05:51 user nova-compute[75342]:     </serial>
Nov 16 18:05:51 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:05:51 user nova-compute[75342]:     <video>
Nov 16 18:05:51 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:05:51 user nova-compute[75342]:     </video>
Nov 16 18:05:51 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:05:51 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:05:51 user nova-compute[75342]:     </rng>
Nov 16 18:05:51 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:05:51 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:05:51 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:05:51 user nova-compute[75342]:     </memballoon>
Nov 16 18:05:51 user nova-compute[75342]:   </devices>
Nov 16 18:05:51 user nova-compute[75342]: </domain>
Nov 16 18:05:51 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-697398401',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-697398401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6973984',id=22,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcwx0Orjt6Ca/Yih36YeYLgaT1UomcNsrVSAhEP/MGM4Su8rNfSWoBkKLpkIFsLHmIXhU1pk0eSs1jdoPm+714n2rlaTIANmtnTlgUx+LV7qePuTEZcr+UgPFnw5xMmzw==',key_name='tempest-keypair-1136982146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d165c413794047efaea43b92a124f937',ramdisk_id='',reservation_id='r-8a46eqj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1722200781',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31989b60047b497081580f6a7c0b7c91',uuid=218bd8cd-58a5-40b3-a989-5aea6a5c9c43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "address": "fa:16:3e:c5:f5:ba", "network": {"id": "84a047a1-f39f-4ca6-a9db-6cc532a1d632", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1681619625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d165c413794047efaea43b92a124f937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258320a2-30", "ovs_interfaceid": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Converting VIF {"id": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "address": "fa:16:3e:c5:f5:ba", "network": {"id": "84a047a1-f39f-4ca6-a9db-6cc532a1d632", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1681619625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d165c413794047efaea43b92a124f937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258320a2-30", "ovs_interfaceid": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f5:ba,bridge_name='br-int',has_traffic_filtering=True,id=258320a2-30f7-4c04-bb9f-49a4caa90b3f,network=Network(84a047a1-f39f-4ca6-a9db-6cc532a1d632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258320a2-30') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_vif [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f5:ba,bridge_name='br-int',has_traffic_filtering=True,id=258320a2-30f7-4c04-bb9f-49a4caa90b3f,network=Network(84a047a1-f39f-4ca6-a9db-6cc532a1d632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258320a2-30') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc40ff88-1e14-52e5-b9a6-b5b36e39e007', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Instance spawned successfully.
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap258320a2-30, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap258320a2-30, col_values=(('qos', UUID('15c6932c-2806-4b0c-ac85-473871823404')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap258320a2-30, col_values=(('external_ids', {'iface-id': '258320a2-30f7-4c04-bb9f-49a4caa90b3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:f5:ba', 'vm-uuid': '218bd8cd-58a5-40b3-a989-5aea6a5c9c43'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:51 user nova-compute[75342]: INFO os_vif [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f5:ba,bridge_name='br-int',has_traffic_filtering=True,id=258320a2-30f7-4c04-bb9f-49a4caa90b3f,network=Network(84a047a1-f39f-4ca6-a9db-6cc532a1d632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258320a2-30')
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfc6c56-9adb-4682-be4f-7d0a35c2bfed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]
Nov 16 18:05:51 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.
Nov 16 18:05:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a41647-f872-4fa9-8d46-afb12d85530c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-67b3e552-4349-4d89-8e99-8af13edaf7c9 req-ef0f352b-5e97-4cc7-81ec-8a65cf8c2aa2 service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Received event network-vif-plugged-89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-67b3e552-4349-4d89-8e99-8af13edaf7c9 req-ef0f352b-5e97-4cc7-81ec-8a65cf8c2aa2 service nova] Acquiring lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-67b3e552-4349-4d89-8e99-8af13edaf7c9 req-ef0f352b-5e97-4cc7-81ec-8a65cf8c2aa2 service nova] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-67b3e552-4349-4d89-8e99-8af13edaf7c9 req-ef0f352b-5e97-4cc7-81ec-8a65cf8c2aa2 service nova] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-67b3e552-4349-4d89-8e99-8af13edaf7c9 req-ef0f352b-5e97-4cc7-81ec-8a65cf8c2aa2 service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] No waiting events found dispatching network-vif-plugged-89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:51 user nova-compute[75342]: WARNING nova.compute.manager [req-67b3e552-4349-4d89-8e99-8af13edaf7c9 req-ef0f352b-5e97-4cc7-81ec-8a65cf8c2aa2 service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Received unexpected event network-vif-plugged-89dc167c-d215-4c26-84ca-f96fb075a578 for instance with vm_state building and task_state spawning.
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] No VIF found with MAC fa:16:3e:c5:f5:ba, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc990c15-b447-4b86-8413-8edfeeb8e981]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:51 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:05:51 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:05:51 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:05:51 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:05:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.444s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:51 user nova-compute[75342]: INFO nova.compute.manager [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Took 7.09 seconds to spawn the instance on the hypervisor.
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[000250b8-bd28-4505-8c0f-70b8354c5732]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrZWgwTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:05:51 user nova-compute[75342]: INFO nova.compute.manager [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Took 8.43 seconds to build instance.
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d97b3ae-969b-4b30-b350-e201bc1b521e tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.578s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.141s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-96eea8d6-dfea-4ca2-969e-be60dc811875 req-c41d4561-7f0c-44e6-b2ab-0e577a397227 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Updated VIF entry in instance network info cache for port 258320a2-30f7-4c04-bb9f-49a4caa90b3f. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-96eea8d6-dfea-4ca2-969e-be60dc811875 req-c41d4561-7f0c-44e6-b2ab-0e577a397227 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Updating instance_info_cache with network_info: [{"id": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "address": "fa:16:3e:c5:f5:ba", "network": {"id": "84a047a1-f39f-4ca6-a9db-6cc532a1d632", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1681619625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d165c413794047efaea43b92a124f937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258320a2-30", "ovs_interfaceid": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:05:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-96eea8d6-dfea-4ca2-969e-be60dc811875 req-c41d4561-7f0c-44e6-b2ab-0e577a397227 service nova] Releasing lock "refresh_cache-218bd8cd-58a5-40b3-a989-5aea6a5c9c43" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] <== connect_volume: return (1492ms) {'type': 'block', 'scsi_wwn': '23130356636653034', 'path': '/dev/sdc'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130356636653034', 'path': '/dev/sdc'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1606614034',display_name='tempest-ServerActionsTestOtherB-server-1606614034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1606614034',id=4,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1UyBGifbaRVIIusr59UKLEcXLfyd6epVSgRuItUg0lc3AijdYFqlIZoLMbi5dO5JpMBiHIhBKHMDap+u4RdhUKBD/7ZLtWgtZhiB+iJEQy+7uabGfTLiM4pLG8U3m+Tg==',key_name='tempest-keypair-290385198',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:04:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f427ee24cf34d538c1b2ae19266b9f3',ramdisk_id='',reservation_id='r-v0hi3c4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-613458522',owner_user_name='tempest-ServerActionsTestOtherB-613458522-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67704d03b80e4d709863960014fbcd24',uuid=2992b5fc-86e6-425f-82e5-cf6358582872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converting VIF {"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:05:52 user nova-compute[75342]:   <uuid>2992b5fc-86e6-425f-82e5-cf6358582872</uuid>
Nov 16 18:05:52 user nova-compute[75342]:   <name>instance-00000004</name>
Nov 16 18:05:52 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:05:52 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:05:52 user nova-compute[75342]:   <metadata>
Nov 16 18:05:52 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:05:52 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:05:52 user nova-compute[75342]:       <nova:name>tempest-ServerActionsTestOtherB-server-1606614034</nova:name>
Nov 16 18:05:52 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:05:50</nova:creationTime>
Nov 16 18:05:52 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:05:52 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:05:52 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:05:52 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:05:52 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:05:52 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:05:52 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:05:52 user nova-compute[75342]:       <nova:owner>
Nov 16 18:05:52 user nova-compute[75342]:         <nova:user uuid="67704d03b80e4d709863960014fbcd24">tempest-ServerActionsTestOtherB-613458522-project-member</nova:user>
Nov 16 18:05:52 user nova-compute[75342]:         <nova:project uuid="2f427ee24cf34d538c1b2ae19266b9f3">tempest-ServerActionsTestOtherB-613458522</nova:project>
Nov 16 18:05:52 user nova-compute[75342]:       </nova:owner>
Nov 16 18:05:52 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:05:52 user nova-compute[75342]:       <nova:ports>
Nov 16 18:05:52 user nova-compute[75342]:         <nova:port uuid="b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf">
Nov 16 18:05:52 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 18:05:52 user nova-compute[75342]:         </nova:port>
Nov 16 18:05:52 user nova-compute[75342]:       </nova:ports>
Nov 16 18:05:52 user nova-compute[75342]:     </nova:instance>
Nov 16 18:05:52 user nova-compute[75342]:   </metadata>
Nov 16 18:05:52 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:05:52 user nova-compute[75342]:     <system>
Nov 16 18:05:52 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:05:52 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:05:52 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:05:52 user nova-compute[75342]:       <entry name="serial">2992b5fc-86e6-425f-82e5-cf6358582872</entry>
Nov 16 18:05:52 user nova-compute[75342]:       <entry name="uuid">2992b5fc-86e6-425f-82e5-cf6358582872</entry>
Nov 16 18:05:52 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:05:52 user nova-compute[75342]:     </system>
Nov 16 18:05:52 user nova-compute[75342]:   </sysinfo>
Nov 16 18:05:52 user nova-compute[75342]:   <os>
Nov 16 18:05:52 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:05:52 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:05:52 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:05:52 user nova-compute[75342]:   </os>
Nov 16 18:05:52 user nova-compute[75342]:   <features>
Nov 16 18:05:52 user nova-compute[75342]:     <acpi/>
Nov 16 18:05:52 user nova-compute[75342]:     <apic/>
Nov 16 18:05:52 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:05:52 user nova-compute[75342]:   </features>
Nov 16 18:05:52 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:05:52 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:05:52 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:05:52 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:05:52 user nova-compute[75342]:   </clock>
Nov 16 18:05:52 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:05:52 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:05:52 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:05:52 user nova-compute[75342]:   </cpu>
Nov 16 18:05:52 user nova-compute[75342]:   <devices>
Nov 16 18:05:52 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:05:52 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:05:52 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk"/>
Nov 16 18:05:52 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:05:52 user nova-compute[75342]:     </disk>
Nov 16 18:05:52 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:05:52 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:05:52 user nova-compute[75342]:       <source dev="/dev/sdc"/>
Nov 16 18:05:52 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:05:52 user nova-compute[75342]:       <serial>a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd</serial>
Nov 16 18:05:52 user nova-compute[75342]:     </disk>
Nov 16 18:05:52 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:05:52 user nova-compute[75342]:       <mac address="fa:16:3e:f5:5a:de"/>
Nov 16 18:05:52 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:05:52 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:05:52 user nova-compute[75342]:       <target dev="tapb2a1cbd5-36"/>
Nov 16 18:05:52 user nova-compute[75342]:     </interface>
Nov 16 18:05:52 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:05:52 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/console.log" append="off"/>
Nov 16 18:05:52 user nova-compute[75342]:     </serial>
Nov 16 18:05:52 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:05:52 user nova-compute[75342]:     <video>
Nov 16 18:05:52 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:05:52 user nova-compute[75342]:     </video>
Nov 16 18:05:52 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:05:52 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:05:52 user nova-compute[75342]:     </rng>
Nov 16 18:05:52 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:05:52 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:05:52 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:05:52 user nova-compute[75342]:     </memballoon>
Nov 16 18:05:52 user nova-compute[75342]:   </devices>
Nov 16 18:05:52 user nova-compute[75342]: </domain>
Nov 16 18:05:52 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1606614034',display_name='tempest-ServerActionsTestOtherB-server-1606614034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1606614034',id=4,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1UyBGifbaRVIIusr59UKLEcXLfyd6epVSgRuItUg0lc3AijdYFqlIZoLMbi5dO5JpMBiHIhBKHMDap+u4RdhUKBD/7ZLtWgtZhiB+iJEQy+7uabGfTLiM4pLG8U3m+Tg==',key_name='tempest-keypair-290385198',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:04:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f427ee24cf34d538c1b2ae19266b9f3',ramdisk_id='',reservation_id='r-v0hi3c4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-613458522',owner_user_name='tempest-ServerActionsTestOtherB-613458522-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67704d03b80e4d709863960014fbcd24',uuid=2992b5fc-86e6-425f-82e5-cf6358582872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converting VIF {"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG os_vif [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1a2f0a8-4f6c-5c3f-91bf-257adf98a023', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2a1cbd5-36, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2a1cbd5-36, col_values=(('qos', UUID('887c2a4d-9ad9-4c75-9b3c-de5dc158c636')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2a1cbd5-36, col_values=(('external_ids', {'iface-id': 'b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:5a:de', 'vm-uuid': '2992b5fc-86e6-425f-82e5-cf6358582872'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:52 user nova-compute[75342]: INFO os_vif [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36')
Nov 16 18:05:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-3d2c3400-c748-4071-bffc-d2901e1b680d req-122312c1-45ad-4d68-864d-7bf80c7a3155 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-changed-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-3d2c3400-c748-4071-bffc-d2901e1b680d req-122312c1-45ad-4d68-864d-7bf80c7a3155 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Refreshing instance network info cache due to event network-changed-70d27952-7221-44f5-b6fb-24d3416b1b2e. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d2c3400-c748-4071-bffc-d2901e1b680d req-122312c1-45ad-4d68-864d-7bf80c7a3155 service nova] Acquiring lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d2c3400-c748-4071-bffc-d2901e1b680d req-122312c1-45ad-4d68-864d-7bf80c7a3155 service nova] Acquired lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG nova.network.neutron [req-3d2c3400-c748-4071-bffc-d2901e1b680d req-122312c1-45ad-4d68-864d-7bf80c7a3155 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Refreshing network info cache for port 70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-cb8f041f-7cef-407d-8cd6-7177f39878a6 req-000a4fa3-4473-4d93-b35f-9bd7a15e8c86 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Received event network-vif-plugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cb8f041f-7cef-407d-8cd6-7177f39878a6 req-000a4fa3-4473-4d93-b35f-9bd7a15e8c86 service nova] Acquiring lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cb8f041f-7cef-407d-8cd6-7177f39878a6 req-000a4fa3-4473-4d93-b35f-9bd7a15e8c86 service nova] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cb8f041f-7cef-407d-8cd6-7177f39878a6 req-000a4fa3-4473-4d93-b35f-9bd7a15e8c86 service nova] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-cb8f041f-7cef-407d-8cd6-7177f39878a6 req-000a4fa3-4473-4d93-b35f-9bd7a15e8c86 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] No waiting events found dispatching network-vif-plugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:53 user nova-compute[75342]: WARNING nova.compute.manager [req-cb8f041f-7cef-407d-8cd6-7177f39878a6 req-000a4fa3-4473-4d93-b35f-9bd7a15e8c86 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Received unexpected event network-vif-plugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f for instance with vm_state building and task_state spawning.
Nov 16 18:05:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-3d2c3400-c748-4071-bffc-d2901e1b680d req-122312c1-45ad-4d68-864d-7bf80c7a3155 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updated VIF entry in instance network info cache for port 70d27952-7221-44f5-b6fb-24d3416b1b2e. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:05:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-3d2c3400-c748-4071-bffc-d2901e1b680d req-122312c1-45ad-4d68-864d-7bf80c7a3155 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updating instance_info_cache with network_info: [{"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:05:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d2c3400-c748-4071-bffc-d2901e1b680d req-122312c1-45ad-4d68-864d-7bf80c7a3155 service nova] Releasing lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:05:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-c45d76b0-30a8-4d5a-9729-54967eaa3a11 req-87f20bbd-3518-4f3b-b063-e6ccc512278b service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Received event network-vif-plugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c45d76b0-30a8-4d5a-9729-54967eaa3a11 req-87f20bbd-3518-4f3b-b063-e6ccc512278b service nova] Acquiring lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c45d76b0-30a8-4d5a-9729-54967eaa3a11 req-87f20bbd-3518-4f3b-b063-e6ccc512278b service nova] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c45d76b0-30a8-4d5a-9729-54967eaa3a11 req-87f20bbd-3518-4f3b-b063-e6ccc512278b service nova] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-c45d76b0-30a8-4d5a-9729-54967eaa3a11 req-87f20bbd-3518-4f3b-b063-e6ccc512278b service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] No waiting events found dispatching network-vif-plugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:55 user nova-compute[75342]: WARNING nova.compute.manager [req-c45d76b0-30a8-4d5a-9729-54967eaa3a11 req-87f20bbd-3518-4f3b-b063-e6ccc512278b service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Received unexpected event network-vif-plugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f for instance with vm_state building and task_state spawning.
Nov 16 18:05:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:56 user nova-compute[75342]: DEBUG nova.compute.manager [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:05:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:05:57 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Instance spawned successfully.
Nov 16 18:05:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:05:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:05:57 user nova-compute[75342]: INFO nova.compute.manager [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Took 8.01 seconds to spawn the instance on the hypervisor.
Nov 16 18:05:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:05:57 user nova-compute[75342]: INFO nova.compute.manager [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Took 9.22 seconds to build instance.
Nov 16 18:05:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31bfeb39-23ac-45b8-af59-58ddf382b2a2 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.396s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:05:57 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance running successfully.
Nov 16 18:05:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] finish_revert_migration finished successfully. {{(pid=75342) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 16 18:05:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:57 user nova-compute[75342]: INFO nova.compute.manager [None req-b32aabbc-5b8d-4b8f-9117-5e5c6e8e5fc8 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating instance to original state: 'active'
Nov 16 18:05:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:58 user nova-compute[75342]: INFO nova.compute.manager [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Shelving
Nov 16 18:05:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-ab19da02-a4ce-4a2f-9fe6-071817d11e9a req-edb7af2e-443b-4193-b56e-952454f01c4b service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-vif-unplugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab19da02-a4ce-4a2f-9fe6-071817d11e9a req-edb7af2e-443b-4193-b56e-952454f01c4b service nova] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab19da02-a4ce-4a2f-9fe6-071817d11e9a req-edb7af2e-443b-4193-b56e-952454f01c4b service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab19da02-a4ce-4a2f-9fe6-071817d11e9a req-edb7af2e-443b-4193-b56e-952454f01c4b service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-ab19da02-a4ce-4a2f-9fe6-071817d11e9a req-edb7af2e-443b-4193-b56e-952454f01c4b service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] No waiting events found dispatching network-vif-unplugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:58 user nova-compute[75342]: WARNING nova.compute.manager [req-ab19da02-a4ce-4a2f-9fe6-071817d11e9a req-edb7af2e-443b-4193-b56e-952454f01c4b service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received unexpected event network-vif-unplugged-70d27952-7221-44f5-b6fb-24d3416b1b2e for instance with vm_state active and task_state shelving.
Nov 16 18:05:59 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Instance destroyed successfully.
Nov 16 18:05:59 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Beginning cold snapshot process
Nov 16 18:05:59 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:05:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk /opt/stack/data/nova/instances/snapshots/tmpbazhz0pr/3569354c39d047558c99ddfced59f505 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:05:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:05:59 user nova-compute[75342]: DEBUG nova.compute.manager [req-70588d5c-5760-4e75-87c2-60f87d357960 req-5766bce1-89fb-4f9b-8f47-1abeb31ce745 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:05:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-70588d5c-5760-4e75-87c2-60f87d357960 req-5766bce1-89fb-4f9b-8f47-1abeb31ce745 service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:05:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-70588d5c-5760-4e75-87c2-60f87d357960 req-5766bce1-89fb-4f9b-8f47-1abeb31ce745 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:05:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-70588d5c-5760-4e75-87c2-60f87d357960 req-5766bce1-89fb-4f9b-8f47-1abeb31ce745 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:05:59 user nova-compute[75342]: DEBUG nova.compute.manager [req-70588d5c-5760-4e75-87c2-60f87d357960 req-5766bce1-89fb-4f9b-8f47-1abeb31ce745 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:05:59 user nova-compute[75342]: WARNING nova.compute.manager [req-70588d5c-5760-4e75-87c2-60f87d357960 req-5766bce1-89fb-4f9b-8f47-1abeb31ce745 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received unexpected event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with vm_state active and task_state None.
Nov 16 18:06:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-3d6c153d-52b1-40c2-a3db-a4a9ac5c0229 req-915451f7-dc7b-4a90-893e-c13a57415c04 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d6c153d-52b1-40c2-a3db-a4a9ac5c0229 req-915451f7-dc7b-4a90-893e-c13a57415c04 service nova] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d6c153d-52b1-40c2-a3db-a4a9ac5c0229 req-915451f7-dc7b-4a90-893e-c13a57415c04 service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d6c153d-52b1-40c2-a3db-a4a9ac5c0229 req-915451f7-dc7b-4a90-893e-c13a57415c04 service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-3d6c153d-52b1-40c2-a3db-a4a9ac5c0229 req-915451f7-dc7b-4a90-893e-c13a57415c04 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] No waiting events found dispatching network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:00 user nova-compute[75342]: WARNING nova.compute.manager [req-3d6c153d-52b1-40c2-a3db-a4a9ac5c0229 req-915451f7-dc7b-4a90-893e-c13a57415c04 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received unexpected event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 16 18:06:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk /opt/stack/data/nova/instances/snapshots/tmpbazhz0pr/3569354c39d047558c99ddfced59f505" returned: 0 in 1.474s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Snapshot extracted, beginning image upload
Nov 16 18:06:01 user nova-compute[75342]: DEBUG nova.compute.manager [req-0b5704ed-3e00-4d4c-8f7f-e930dfa8f6fb req-98a99bd9-d7bb-4c1b-a5bd-3738d776c726 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0b5704ed-3e00-4d4c-8f7f-e930dfa8f6fb req-98a99bd9-d7bb-4c1b-a5bd-3738d776c726 service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0b5704ed-3e00-4d4c-8f7f-e930dfa8f6fb req-98a99bd9-d7bb-4c1b-a5bd-3738d776c726 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0b5704ed-3e00-4d4c-8f7f-e930dfa8f6fb req-98a99bd9-d7bb-4c1b-a5bd-3738d776c726 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:01 user nova-compute[75342]: DEBUG nova.compute.manager [req-0b5704ed-3e00-4d4c-8f7f-e930dfa8f6fb req-98a99bd9-d7bb-4c1b-a5bd-3738d776c726 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:01 user nova-compute[75342]: WARNING nova.compute.manager [req-0b5704ed-3e00-4d4c-8f7f-e930dfa8f6fb req-98a99bd9-d7bb-4c1b-a5bd-3738d776c726 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received unexpected event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with vm_state active and task_state None.
Nov 16 18:06:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:04 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Snapshot image upload complete
Nov 16 18:06:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:06:04 user nova-compute[75342]: INFO nova.compute.manager [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Shelve offloading
Nov 16 18:06:04 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Instance destroyed successfully.
Nov 16 18:06:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:06:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:06:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquired lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:06:04 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updating instance_info_cache with network_info: [{"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Releasing lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:06:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Instance destroyed successfully.
Nov 16 18:06:05 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'resources' on Instance uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539067305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539067305',id=19,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQOSo7uIdt9k/PLg6VsDFmL+PRo3dwsxAbcVSW3Wj40XjIJQYbNLBtz/3H+zlgRaTYbZ1HgboxKf6Gyi0Z2bFK+BAiKEPzbjUjlAGPu0n8gqG1SnPKxOjVIlr4Yh7ayVQ==',key_name='tempest-keypair-279505456',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-4tz76pmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member',shelved_at='2023-11-16T18:06:04.458438',shelved_host='user',shelved_image_id='c442e114-8792-494f-b052-c81603f25a78'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:06:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=fb00d09d-d7c3-43f8-a118-26868011460b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG os_vif [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-062eb0d1-9e69-433f-9c15-74669d1be15e req-da78ebd4-3c78-4741-9ddc-775bbbb7dae2 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-changed-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-062eb0d1-9e69-433f-9c15-74669d1be15e req-da78ebd4-3c78-4741-9ddc-775bbbb7dae2 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Refreshing instance network info cache due to event network-changed-70d27952-7221-44f5-b6fb-24d3416b1b2e. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-062eb0d1-9e69-433f-9c15-74669d1be15e req-da78ebd4-3c78-4741-9ddc-775bbbb7dae2 service nova] Acquiring lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-062eb0d1-9e69-433f-9c15-74669d1be15e req-da78ebd4-3c78-4741-9ddc-775bbbb7dae2 service nova] Acquired lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG nova.network.neutron [req-062eb0d1-9e69-433f-9c15-74669d1be15e req-da78ebd4-3c78-4741-9ddc-775bbbb7dae2 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Refreshing network info cache for port 70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70d27952-72, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=882084e2-5c24-4b6e-a99c-ff3da79384f3) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:06:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:05 user nova-compute[75342]: INFO os_vif [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72')
Nov 16 18:06:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Deleting instance files /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b_del
Nov 16 18:06:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Deletion of /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b_del complete
Nov 16 18:06:06 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Deleted allocations for instance fb00d09d-d7c3-43f8-a118-26868011460b
Nov 16 18:06:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'numa_topology' on Instance uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG nova.objects.base [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Object Instance<fb00d09d-d7c3-43f8-a118-26868011460b> lazy-loaded attributes: resources,numa_topology {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Acquiring lock "8b5474bd-3446-452a-adb4-63138de26b3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "8b5474bd-3446-452a-adb4-63138de26b3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Acquiring lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:06 user nova-compute[75342]: INFO nova.compute.manager [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Terminating instance
Nov 16 18:06:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-062eb0d1-9e69-433f-9c15-74669d1be15e req-da78ebd4-3c78-4741-9ddc-775bbbb7dae2 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updated VIF entry in instance network info cache for port 70d27952-7221-44f5-b6fb-24d3416b1b2e. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-062eb0d1-9e69-433f-9c15-74669d1be15e req-da78ebd4-3c78-4741-9ddc-775bbbb7dae2 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updating instance_info_cache with network_info: [{"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap70d27952-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-062eb0d1-9e69-433f-9c15-74669d1be15e req-da78ebd4-3c78-4741-9ddc-775bbbb7dae2 service nova] Releasing lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:06:06 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.814s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b4930003-bea7-4616-a699-a8bfbd57d5a0 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.190s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Instance destroyed successfully.
Nov 16 18:06:07 user nova-compute[75342]: DEBUG nova.objects.instance [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lazy-loading 'resources' on Instance uuid 8b5474bd-3446-452a-adb4-63138de26b3d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-955240700',display_name='tempest-VolumesActionsTest-instance-955240700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-955240700',id=20,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:04:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d6892c1b7794d41a275f70883125d11',ramdisk_id='',reservation_id='r-rc26wq6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-528330809',owner_user_name='tempest-VolumesActionsTest-528330809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:04:15Z,user_data=None,user_id='c0e629a008074df3a1ae71096540d77c',uuid=8b5474bd-3446-452a-adb4-63138de26b3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "address": "fa:16:3e:a3:05:62", "network": {"id": "b2a9154b-3516-4b0d-81bf-834846aafa8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450872312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6892c1b7794d41a275f70883125d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89571ae-40", "ovs_interfaceid": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Converting VIF {"id": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "address": "fa:16:3e:a3:05:62", "network": {"id": "b2a9154b-3516-4b0d-81bf-834846aafa8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-450872312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6892c1b7794d41a275f70883125d11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb89571ae-40", "ovs_interfaceid": "b89571ae-400a-4458-a0f9-3f7ab07b2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:62,bridge_name='br-int',has_traffic_filtering=True,id=b89571ae-400a-4458-a0f9-3f7ab07b2ca0,network=Network(b2a9154b-3516-4b0d-81bf-834846aafa8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89571ae-40') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG os_vif [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:62,bridge_name='br-int',has_traffic_filtering=True,id=b89571ae-400a-4458-a0f9-3f7ab07b2ca0,network=Network(b2a9154b-3516-4b0d-81bf-834846aafa8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89571ae-40') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb89571ae-40, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cc69a81-c113-427b-967d-a9a24613b07a) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:06:07 user nova-compute[75342]: INFO os_vif [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:62,bridge_name='br-int',has_traffic_filtering=True,id=b89571ae-400a-4458-a0f9-3f7ab07b2ca0,network=Network(b2a9154b-3516-4b0d-81bf-834846aafa8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb89571ae-40')
Nov 16 18:06:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Deleting instance files /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d_del
Nov 16 18:06:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Deletion of /opt/stack/data/nova/instances/8b5474bd-3446-452a-adb4-63138de26b3d_del complete
Nov 16 18:06:07 user nova-compute[75342]: INFO nova.compute.manager [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 16 18:06:07 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:06:07 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Took 0.46 seconds to deallocate network for instance.
Nov 16 18:06:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-a8599478-fd3a-40c1-9d99-6b401254d9af req-8b51285e-35e6-46ab-9ed3-403ff4da7462 service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Received event network-vif-deleted-b89571ae-400a-4458-a0f9-3f7ab07b2ca0 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-34af0cc4-bfe7-4f7c-8c27-3afcbcd72e75 req-e5423d59-ed59-4483-9d15-b0ae262eafce service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Received event network-vif-plugged-b89571ae-400a-4458-a0f9-3f7ab07b2ca0 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34af0cc4-bfe7-4f7c-8c27-3afcbcd72e75 req-e5423d59-ed59-4483-9d15-b0ae262eafce service nova] Acquiring lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34af0cc4-bfe7-4f7c-8c27-3afcbcd72e75 req-e5423d59-ed59-4483-9d15-b0ae262eafce service nova] Lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34af0cc4-bfe7-4f7c-8c27-3afcbcd72e75 req-e5423d59-ed59-4483-9d15-b0ae262eafce service nova] Lock "8b5474bd-3446-452a-adb4-63138de26b3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-34af0cc4-bfe7-4f7c-8c27-3afcbcd72e75 req-e5423d59-ed59-4483-9d15-b0ae262eafce service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] No waiting events found dispatching network-vif-plugged-b89571ae-400a-4458-a0f9-3f7ab07b2ca0 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:07 user nova-compute[75342]: WARNING nova.compute.manager [req-34af0cc4-bfe7-4f7c-8c27-3afcbcd72e75 req-e5423d59-ed59-4483-9d15-b0ae262eafce service nova] [instance: 8b5474bd-3446-452a-adb4-63138de26b3d] Received unexpected event network-vif-plugged-b89571ae-400a-4458-a0f9-3f7ab07b2ca0 for instance with vm_state active and task_state deleting.
Nov 16 18:06:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:08 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:06:08 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:06:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:08 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Deleted allocations for instance 8b5474bd-3446-452a-adb4-63138de26b3d
Nov 16 18:06:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37716c18-a401-4c46-ba0f-da0f18f32748 tempest-VolumesActionsTest-528330809 tempest-VolumesActionsTest-528330809-project-member] Lock "8b5474bd-3446-452a-adb4-63138de26b3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.207s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:12 user nova-compute[75342]: DEBUG nova.compute.manager [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:06:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:06:12 user nova-compute[75342]: INFO nova.compute.claims [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Claim successful on node user
Nov 16 18:06:12 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:06:12 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:06:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:12 user nova-compute[75342]: DEBUG nova.compute.manager [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:06:13 user nova-compute[75342]: DEBUG nova.compute.manager [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:06:13 user nova-compute[75342]: DEBUG nova.network.neutron [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:06:13 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:06:13 user nova-compute[75342]: DEBUG nova.compute.manager [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:06:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:13 user nova-compute[75342]: DEBUG nova.policy [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '062cd6d338014493be6c40701d2a735b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d44dce2b444ef386b47927d5c70c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:06:13 user nova-compute[75342]: INFO nova.virt.block_device [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Booting with volume snapshot b56cd0d1-b8ff-46be-8248-27b336c5edb2 at /dev/vda
Nov 16 18:06:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:14 user nova-compute[75342]: DEBUG nova.network.neutron [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Successfully created port: ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:06:14 user nova-compute[75342]: DEBUG nova.network.neutron [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Successfully updated port: ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:06:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "refresh_cache-d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:06:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquired lock "refresh_cache-d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:06:14 user nova-compute[75342]: DEBUG nova.network.neutron [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:06:14 user nova-compute[75342]: DEBUG nova.compute.manager [req-81fcf27e-1fbc-41e3-a43d-5e9680d568fb req-23e2bce3-e488-47f7-a61e-0602ec6fe189 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Received event network-changed-ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:14 user nova-compute[75342]: DEBUG nova.compute.manager [req-81fcf27e-1fbc-41e3-a43d-5e9680d568fb req-23e2bce3-e488-47f7-a61e-0602ec6fe189 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Refreshing instance network info cache due to event network-changed-ef11f485-5e98-470a-b000-44ce8fb72863. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:06:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-81fcf27e-1fbc-41e3-a43d-5e9680d568fb req-23e2bce3-e488-47f7-a61e-0602ec6fe189 service nova] Acquiring lock "refresh_cache-d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:06:14 user nova-compute[75342]: DEBUG nova.network.neutron [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:06:15 user nova-compute[75342]: DEBUG nova.network.neutron [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Updating instance_info_cache with network_info: [{"id": "ef11f485-5e98-470a-b000-44ce8fb72863", "address": "fa:16:3e:f6:4b:12", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef11f485-5e", "ovs_interfaceid": "ef11f485-5e98-470a-b000-44ce8fb72863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:06:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Releasing lock "refresh_cache-d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:06:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Instance network_info: |[{"id": "ef11f485-5e98-470a-b000-44ce8fb72863", "address": "fa:16:3e:f6:4b:12", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef11f485-5e", "ovs_interfaceid": "ef11f485-5e98-470a-b000-44ce8fb72863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:06:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-81fcf27e-1fbc-41e3-a43d-5e9680d568fb req-23e2bce3-e488-47f7-a61e-0602ec6fe189 service nova] Acquired lock "refresh_cache-d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:06:15 user nova-compute[75342]: DEBUG nova.network.neutron [req-81fcf27e-1fbc-41e3-a43d-5e9680d568fb req-23e2bce3-e488-47f7-a61e-0602ec6fe189 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Refreshing network info cache for port ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:06:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:15 user nova-compute[75342]: DEBUG nova.network.neutron [req-81fcf27e-1fbc-41e3-a43d-5e9680d568fb req-23e2bce3-e488-47f7-a61e-0602ec6fe189 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Updated VIF entry in instance network info cache for port ef11f485-5e98-470a-b000-44ce8fb72863. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:06:15 user nova-compute[75342]: DEBUG nova.network.neutron [req-81fcf27e-1fbc-41e3-a43d-5e9680d568fb req-23e2bce3-e488-47f7-a61e-0602ec6fe189 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Updating instance_info_cache with network_info: [{"id": "ef11f485-5e98-470a-b000-44ce8fb72863", "address": "fa:16:3e:f6:4b:12", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef11f485-5e", "ovs_interfaceid": "ef11f485-5e98-470a-b000-44ce8fb72863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:06:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-81fcf27e-1fbc-41e3-a43d-5e9680d568fb req-23e2bce3-e488-47f7-a61e-0602ec6fe189 service nova] Releasing lock "refresh_cache-d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:06:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "9b8d894f-9e43-4745-8a22-dc368a472320" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "9b8d894f-9e43-4745-8a22-dc368a472320" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:06:18 user nova-compute[75342]: INFO nova.compute.claims [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Claim successful on node user
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.network.neutron [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:06:18 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG os_brick.utils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[23657115-e19b-4e7a-9795-5a21d6d2c103]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d69812-f4d9-4ae9-8229-3269ba5fb27c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.policy [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd02be1850ee43f8943d236ed1093864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9d3323184440bfa3a59fe001304b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29eb5de-7f0d-4d85-950d-45c730555239]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f49b8d-958e-4e18-a7e9-c4516fb70048]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:06:18 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Creating image(s)
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "/opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "/opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:06:18 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ec749b-5360-41ea-931c-cacaf416c8cd]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG os_brick.utils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Updating existing volume attachment record: 16209603-5fdd-4561-a53e-affa8ea6b7d0 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:06:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.169s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk 1073741824" returned: 0 in 0.050s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.164s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Cannot resize image /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Ensure instance console log exists: /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:19 user nova-compute[75342]: DEBUG nova.network.neutron [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Successfully created port: 7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Successfully updated port: 7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "refresh_cache-9b8d894f-9e43-4745-8a22-dc368a472320" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquired lock "refresh_cache-9b8d894f-9e43-4745-8a22-dc368a472320" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-453a3f77-5c27-444d-9976-495cf539cd2b req-d98eb089-7f22-454f-a0e9-8ac3524d182c service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Received event network-changed-7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-453a3f77-5c27-444d-9976-495cf539cd2b req-d98eb089-7f22-454f-a0e9-8ac3524d182c service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Refreshing instance network info cache due to event network-changed-7482aa27-469e-4e49-b956-ca5bf5dcd7bf. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-453a3f77-5c27-444d-9976-495cf539cd2b req-d98eb089-7f22-454f-a0e9-8ac3524d182c service nova] Acquiring lock "refresh_cache-9b8d894f-9e43-4745-8a22-dc368a472320" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Updating instance_info_cache with network_info: [{"id": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "address": "fa:16:3e:db:80:1f", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482aa27-46", "ovs_interfaceid": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Releasing lock "refresh_cache-9b8d894f-9e43-4745-8a22-dc368a472320" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Instance network_info: |[{"id": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "address": "fa:16:3e:db:80:1f", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482aa27-46", "ovs_interfaceid": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-453a3f77-5c27-444d-9976-495cf539cd2b req-d98eb089-7f22-454f-a0e9-8ac3524d182c service nova] Acquired lock "refresh_cache-9b8d894f-9e43-4745-8a22-dc368a472320" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.network.neutron [req-453a3f77-5c27-444d-9976-495cf539cd2b req-d98eb089-7f22-454f-a0e9-8ac3524d182c service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Refreshing network info cache for port 7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Start _get_guest_xml network_info=[{"id": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "address": "fa:16:3e:db:80:1f", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482aa27-46", "ovs_interfaceid": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:06:20 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:06:20 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-557315286',display_name='tempest-VolumesActionsTest-instance-557315286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-557315286',id=24,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9d3323184440bfa3a59fe001304b3b',ramdisk_id='',reservation_id='r-oa09sjx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1486004135',owner_user_name='tempest-VolumesActionsTest-1486004135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:06:19Z,user_data=None,user_id='fd02be1850ee43f8943d236ed1093864',uuid=9b8d894f-9e43-4745-8a22-dc368a472320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "address": "fa:16:3e:db:80:1f", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482aa27-46", "ovs_interfaceid": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converting VIF {"id": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "address": "fa:16:3e:db:80:1f", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482aa27-46", "ovs_interfaceid": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=7482aa27-469e-4e49-b956-ca5bf5dcd7bf,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482aa27-46') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.objects.instance [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b8d894f-9e43-4745-8a22-dc368a472320 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:06:20 user nova-compute[75342]:   <uuid>9b8d894f-9e43-4745-8a22-dc368a472320</uuid>
Nov 16 18:06:20 user nova-compute[75342]:   <name>instance-00000018</name>
Nov 16 18:06:20 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:06:20 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:06:20 user nova-compute[75342]:   <metadata>
Nov 16 18:06:20 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:06:20 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:06:20 user nova-compute[75342]:       <nova:name>tempest-VolumesActionsTest-instance-557315286</nova:name>
Nov 16 18:06:20 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:06:20</nova:creationTime>
Nov 16 18:06:20 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:06:20 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:06:20 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:06:20 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:06:20 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:06:20 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:06:20 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:06:20 user nova-compute[75342]:       <nova:owner>
Nov 16 18:06:20 user nova-compute[75342]:         <nova:user uuid="fd02be1850ee43f8943d236ed1093864">tempest-VolumesActionsTest-1486004135-project-member</nova:user>
Nov 16 18:06:20 user nova-compute[75342]:         <nova:project uuid="ab9d3323184440bfa3a59fe001304b3b">tempest-VolumesActionsTest-1486004135</nova:project>
Nov 16 18:06:20 user nova-compute[75342]:       </nova:owner>
Nov 16 18:06:20 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:06:20 user nova-compute[75342]:       <nova:ports>
Nov 16 18:06:20 user nova-compute[75342]:         <nova:port uuid="7482aa27-469e-4e49-b956-ca5bf5dcd7bf">
Nov 16 18:06:20 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 18:06:20 user nova-compute[75342]:         </nova:port>
Nov 16 18:06:20 user nova-compute[75342]:       </nova:ports>
Nov 16 18:06:20 user nova-compute[75342]:     </nova:instance>
Nov 16 18:06:20 user nova-compute[75342]:   </metadata>
Nov 16 18:06:20 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:06:20 user nova-compute[75342]:     <system>
Nov 16 18:06:20 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:06:20 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:06:20 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:06:20 user nova-compute[75342]:       <entry name="serial">9b8d894f-9e43-4745-8a22-dc368a472320</entry>
Nov 16 18:06:20 user nova-compute[75342]:       <entry name="uuid">9b8d894f-9e43-4745-8a22-dc368a472320</entry>
Nov 16 18:06:20 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:06:20 user nova-compute[75342]:     </system>
Nov 16 18:06:20 user nova-compute[75342]:   </sysinfo>
Nov 16 18:06:20 user nova-compute[75342]:   <os>
Nov 16 18:06:20 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:06:20 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:06:20 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:06:20 user nova-compute[75342]:   </os>
Nov 16 18:06:20 user nova-compute[75342]:   <features>
Nov 16 18:06:20 user nova-compute[75342]:     <acpi/>
Nov 16 18:06:20 user nova-compute[75342]:     <apic/>
Nov 16 18:06:20 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:06:20 user nova-compute[75342]:   </features>
Nov 16 18:06:20 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:06:20 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:06:20 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:06:20 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:06:20 user nova-compute[75342]:   </clock>
Nov 16 18:06:20 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:06:20 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:06:20 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:06:20 user nova-compute[75342]:   </cpu>
Nov 16 18:06:20 user nova-compute[75342]:   <devices>
Nov 16 18:06:20 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:06:20 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:06:20 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk"/>
Nov 16 18:06:20 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:06:20 user nova-compute[75342]:     </disk>
Nov 16 18:06:20 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:06:20 user nova-compute[75342]:       <mac address="fa:16:3e:db:80:1f"/>
Nov 16 18:06:20 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:06:20 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:06:20 user nova-compute[75342]:       <target dev="tap7482aa27-46"/>
Nov 16 18:06:20 user nova-compute[75342]:     </interface>
Nov 16 18:06:20 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:06:20 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/console.log" append="off"/>
Nov 16 18:06:20 user nova-compute[75342]:     </serial>
Nov 16 18:06:20 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:06:20 user nova-compute[75342]:     <video>
Nov 16 18:06:20 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:06:20 user nova-compute[75342]:     </video>
Nov 16 18:06:20 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:06:20 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:06:20 user nova-compute[75342]:     </rng>
Nov 16 18:06:20 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:06:20 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:06:20 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:06:20 user nova-compute[75342]:     </memballoon>
Nov 16 18:06:20 user nova-compute[75342]:   </devices>
Nov 16 18:06:20 user nova-compute[75342]: </domain>
Nov 16 18:06:20 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-557315286',display_name='tempest-VolumesActionsTest-instance-557315286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-557315286',id=24,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9d3323184440bfa3a59fe001304b3b',ramdisk_id='',reservation_id='r-oa09sjx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1486004135',owner_user_name='tempest-VolumesActionsTest-1486004135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:06:19Z,user_data=None,user_id='fd02be1850ee43f8943d236ed1093864',uuid=9b8d894f-9e43-4745-8a22-dc368a472320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "address": "fa:16:3e:db:80:1f", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482aa27-46", "ovs_interfaceid": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converting VIF {"id": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "address": "fa:16:3e:db:80:1f", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482aa27-46", "ovs_interfaceid": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=7482aa27-469e-4e49-b956-ca5bf5dcd7bf,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482aa27-46') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG os_vif [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=7482aa27-469e-4e49-b956-ca5bf5dcd7bf,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482aa27-46') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bd9a41e-41ea-5b07-8091-fa6d0bd468ad', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7482aa27-46, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7482aa27-46, col_values=(('qos', UUID('e9892999-0222-4059-84fc-3b806643f8be')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7482aa27-46, col_values=(('external_ids', {'iface-id': '7482aa27-469e-4e49-b956-ca5bf5dcd7bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:80:1f', 'vm-uuid': '9b8d894f-9e43-4745-8a22-dc368a472320'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:06:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:20 user nova-compute[75342]: INFO os_vif [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=7482aa27-469e-4e49-b956-ca5bf5dcd7bf,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482aa27-46')
Nov 16 18:06:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:06:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] No VIF found with MAC fa:16:3e:db:80:1f, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:06:21 user nova-compute[75342]: DEBUG nova.network.neutron [req-453a3f77-5c27-444d-9976-495cf539cd2b req-d98eb089-7f22-454f-a0e9-8ac3524d182c service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Updated VIF entry in instance network info cache for port 7482aa27-469e-4e49-b956-ca5bf5dcd7bf. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:06:21 user nova-compute[75342]: DEBUG nova.network.neutron [req-453a3f77-5c27-444d-9976-495cf539cd2b req-d98eb089-7f22-454f-a0e9-8ac3524d182c service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Updating instance_info_cache with network_info: [{"id": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "address": "fa:16:3e:db:80:1f", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482aa27-46", "ovs_interfaceid": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:06:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-453a3f77-5c27-444d-9976-495cf539cd2b req-d98eb089-7f22-454f-a0e9-8ac3524d182c service nova] Releasing lock "refresh_cache-9b8d894f-9e43-4745-8a22-dc368a472320" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:06:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-e7cbca53-d64d-46d4-a8a8-b0fcc655493e req-d9579e72-b849-4930-a6b1-ecc67334f67c service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Received event network-vif-plugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7cbca53-d64d-46d4-a8a8-b0fcc655493e req-d9579e72-b849-4930-a6b1-ecc67334f67c service nova] Acquiring lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7cbca53-d64d-46d4-a8a8-b0fcc655493e req-d9579e72-b849-4930-a6b1-ecc67334f67c service nova] Lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7cbca53-d64d-46d4-a8a8-b0fcc655493e req-d9579e72-b849-4930-a6b1-ecc67334f67c service nova] Lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-e7cbca53-d64d-46d4-a8a8-b0fcc655493e req-d9579e72-b849-4930-a6b1-ecc67334f67c service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] No waiting events found dispatching network-vif-plugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:22 user nova-compute[75342]: WARNING nova.compute.manager [req-e7cbca53-d64d-46d4-a8a8-b0fcc655493e req-d9579e72-b849-4930-a6b1-ecc67334f67c service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Received unexpected event network-vif-plugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf for instance with vm_state building and task_state spawning.
Nov 16 18:06:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:06:24 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Creating image(s)
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Ensure instance console log exists: /opt/stack/data/nova/instances/d7c1a9b7-9251-4d6e-ae82-5176535eb9eb/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Start _get_guest_xml network_info=[{"id": "ef11f485-5e98-470a-b000-44ce8fb72863", "address": "fa:16:3e:f6:4b:12", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef11f485-5e", "ovs_interfaceid": "ef11f485-5e98-470a-b000-44ce8fb72863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '16209603-5fdd-4561-a53e-affa8ea6b7d0', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUKWbEwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7c1a9b7-9251-4d6e-ae82-5176535eb9eb', 'attached_at': '', 'detached_at': '', 'volume_id': '92bbaa28-751e-4e8a-999f-4a6d3c390439', 'serial': '92bbaa28-751e-4e8a-999f-4a6d3c390439'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:06:24 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:06:24 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUKWbEwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:06:24 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:06:24 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:06:24 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b4aef5-caf8-49af-a8e9-6a2ad045e9bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:06:24 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed907c12-f39c-4269-97f8-f60916e34c65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439] added
Nov 16 18:06:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5720343-87dd-4114-9a20-5462414a2871]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7a49f8-ed01-4b2d-aa03-7dc749d58a40]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUKWbEwQ {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUKWbEwQ" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ff3f25-0a24-4563-9d8a-a42b5f6b3bae]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUKWbEwQ'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7974003-57a4-4e94-8989-442db07e56d1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa0e67e-6c94-4906-87cc-da50b2468f0e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:06:24 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:06:24 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:06:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:06:24 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:06:24 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:06:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[705dc079-3b88-4f2a-aa78-e7ccac363a8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439, portal: 172.16.0.220,3260]
Nov 16 18:06:24 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439, portal: 172.16.0.220,3260] successful.
Nov 16 18:06:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[98903284-a681-457b-bc37-c8a72be3c898]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d30c10-5ebf-42df-918f-ccb085cd6ad1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:06:24 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:06:24 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:06:24 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:06:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:06:24 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:06:24 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:06:24 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:06:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:24 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Instance spawned successfully.
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f193f647-d24d-488d-b160-49c38d4ea820]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUKWbEwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:24 user nova-compute[75342]: INFO nova.compute.manager [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-ac0ccdb6-7af0-404f-b20e-bbeab643ef42 req-3d028465-c5dc-4657-8282-5d6792f4275c service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Received event network-vif-plugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ac0ccdb6-7af0-404f-b20e-bbeab643ef42 req-3d028465-c5dc-4657-8282-5d6792f4275c service nova] Acquiring lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ac0ccdb6-7af0-404f-b20e-bbeab643ef42 req-3d028465-c5dc-4657-8282-5d6792f4275c service nova] Lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ac0ccdb6-7af0-404f-b20e-bbeab643ef42 req-3d028465-c5dc-4657-8282-5d6792f4275c service nova] Lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-ac0ccdb6-7af0-404f-b20e-bbeab643ef42 req-3d028465-c5dc-4657-8282-5d6792f4275c service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] No waiting events found dispatching network-vif-plugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:24 user nova-compute[75342]: WARNING nova.compute.manager [req-ac0ccdb6-7af0-404f-b20e-bbeab643ef42 req-3d028465-c5dc-4657-8282-5d6792f4275c service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Received unexpected event network-vif-plugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf for instance with vm_state building and task_state spawning.
Nov 16 18:06:24 user nova-compute[75342]: INFO nova.compute.manager [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Took 6.70 seconds to build instance.
Nov 16 18:06:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-136bc092-6067-4ff2-b9f1-61395ef06c18 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "9b8d894f-9e43-4745-8a22-dc368a472320" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.783s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26331316631313966', 'path': '/dev/sde'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331316631313966', 'path': '/dev/sde'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1326851804',display_name='tempest-TestVolumeBootPattern-server-1326851804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1326851804',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-2316l0od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:06:13Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=d7c1a9b7-9251-4d6e-ae82-5176535eb9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef11f485-5e98-470a-b000-44ce8fb72863", "address": "fa:16:3e:f6:4b:12", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef11f485-5e", "ovs_interfaceid": "ef11f485-5e98-470a-b000-44ce8fb72863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "ef11f485-5e98-470a-b000-44ce8fb72863", "address": "fa:16:3e:f6:4b:12", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef11f485-5e", "ovs_interfaceid": "ef11f485-5e98-470a-b000-44ce8fb72863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:4b:12,bridge_name='br-int',has_traffic_filtering=True,id=ef11f485-5e98-470a-b000-44ce8fb72863,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef11f485-5e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG nova.objects.instance [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'pci_devices' on Instance uuid d7c1a9b7-9251-4d6e-ae82-5176535eb9eb {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:06:25 user nova-compute[75342]:   <uuid>d7c1a9b7-9251-4d6e-ae82-5176535eb9eb</uuid>
Nov 16 18:06:25 user nova-compute[75342]:   <name>instance-00000017</name>
Nov 16 18:06:25 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:06:25 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:06:25 user nova-compute[75342]:   <metadata>
Nov 16 18:06:25 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:06:25 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:06:25 user nova-compute[75342]:       <nova:name>tempest-TestVolumeBootPattern-server-1326851804</nova:name>
Nov 16 18:06:25 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:06:24</nova:creationTime>
Nov 16 18:06:25 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:06:25 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:06:25 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:06:25 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:06:25 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:06:25 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:06:25 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:06:25 user nova-compute[75342]:       <nova:owner>
Nov 16 18:06:25 user nova-compute[75342]:         <nova:user uuid="062cd6d338014493be6c40701d2a735b">tempest-TestVolumeBootPattern-312873750-project-member</nova:user>
Nov 16 18:06:25 user nova-compute[75342]:         <nova:project uuid="46d44dce2b444ef386b47927d5c70c8e">tempest-TestVolumeBootPattern-312873750</nova:project>
Nov 16 18:06:25 user nova-compute[75342]:       </nova:owner>
Nov 16 18:06:25 user nova-compute[75342]:       <nova:ports>
Nov 16 18:06:25 user nova-compute[75342]:         <nova:port uuid="ef11f485-5e98-470a-b000-44ce8fb72863">
Nov 16 18:06:25 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 18:06:25 user nova-compute[75342]:         </nova:port>
Nov 16 18:06:25 user nova-compute[75342]:       </nova:ports>
Nov 16 18:06:25 user nova-compute[75342]:     </nova:instance>
Nov 16 18:06:25 user nova-compute[75342]:   </metadata>
Nov 16 18:06:25 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:06:25 user nova-compute[75342]:     <system>
Nov 16 18:06:25 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:06:25 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:06:25 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:06:25 user nova-compute[75342]:       <entry name="serial">d7c1a9b7-9251-4d6e-ae82-5176535eb9eb</entry>
Nov 16 18:06:25 user nova-compute[75342]:       <entry name="uuid">d7c1a9b7-9251-4d6e-ae82-5176535eb9eb</entry>
Nov 16 18:06:25 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:06:25 user nova-compute[75342]:     </system>
Nov 16 18:06:25 user nova-compute[75342]:   </sysinfo>
Nov 16 18:06:25 user nova-compute[75342]:   <os>
Nov 16 18:06:25 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:06:25 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:06:25 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:06:25 user nova-compute[75342]:   </os>
Nov 16 18:06:25 user nova-compute[75342]:   <features>
Nov 16 18:06:25 user nova-compute[75342]:     <acpi/>
Nov 16 18:06:25 user nova-compute[75342]:     <apic/>
Nov 16 18:06:25 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:06:25 user nova-compute[75342]:   </features>
Nov 16 18:06:25 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:06:25 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:06:25 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:06:25 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:06:25 user nova-compute[75342]:   </clock>
Nov 16 18:06:25 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:06:25 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:06:25 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:06:25 user nova-compute[75342]:   </cpu>
Nov 16 18:06:25 user nova-compute[75342]:   <devices>
Nov 16 18:06:25 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:06:25 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:06:25 user nova-compute[75342]:       <source dev="/dev/sde"/>
Nov 16 18:06:25 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:06:25 user nova-compute[75342]:       <serial>92bbaa28-751e-4e8a-999f-4a6d3c390439</serial>
Nov 16 18:06:25 user nova-compute[75342]:     </disk>
Nov 16 18:06:25 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:06:25 user nova-compute[75342]:       <mac address="fa:16:3e:f6:4b:12"/>
Nov 16 18:06:25 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:06:25 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:06:25 user nova-compute[75342]:       <target dev="tapef11f485-5e"/>
Nov 16 18:06:25 user nova-compute[75342]:     </interface>
Nov 16 18:06:25 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:06:25 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/d7c1a9b7-9251-4d6e-ae82-5176535eb9eb/console.log" append="off"/>
Nov 16 18:06:25 user nova-compute[75342]:     </serial>
Nov 16 18:06:25 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:06:25 user nova-compute[75342]:     <video>
Nov 16 18:06:25 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:06:25 user nova-compute[75342]:     </video>
Nov 16 18:06:25 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:06:25 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:06:25 user nova-compute[75342]:     </rng>
Nov 16 18:06:25 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:06:25 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:06:25 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:06:25 user nova-compute[75342]:     </memballoon>
Nov 16 18:06:25 user nova-compute[75342]:   </devices>
Nov 16 18:06:25 user nova-compute[75342]: </domain>
Nov 16 18:06:25 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1326851804',display_name='tempest-TestVolumeBootPattern-server-1326851804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1326851804',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-2316l0od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:06:13Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=d7c1a9b7-9251-4d6e-ae82-5176535eb9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef11f485-5e98-470a-b000-44ce8fb72863", "address": "fa:16:3e:f6:4b:12", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef11f485-5e", "ovs_interfaceid": "ef11f485-5e98-470a-b000-44ce8fb72863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "ef11f485-5e98-470a-b000-44ce8fb72863", "address": "fa:16:3e:f6:4b:12", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef11f485-5e", "ovs_interfaceid": "ef11f485-5e98-470a-b000-44ce8fb72863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:4b:12,bridge_name='br-int',has_traffic_filtering=True,id=ef11f485-5e98-470a-b000-44ce8fb72863,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef11f485-5e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG os_vif [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:4b:12,bridge_name='br-int',has_traffic_filtering=True,id=ef11f485-5e98-470a-b000-44ce8fb72863,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef11f485-5e') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '319b3b90-9d5c-5d5f-b542-6cb9104eafb6', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef11f485-5e, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef11f485-5e, col_values=(('qos', UUID('58d0be51-a7ed-49ce-9f75-12e76e6d20f0')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef11f485-5e, col_values=(('external_ids', {'iface-id': 'ef11f485-5e98-470a-b000-44ce8fb72863', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:4b:12', 'vm-uuid': 'd7c1a9b7-9251-4d6e-ae82-5176535eb9eb'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:25 user nova-compute[75342]: INFO os_vif [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:4b:12,bridge_name='br-int',has_traffic_filtering=True,id=ef11f485-5e98-470a-b000-44ce8fb72863,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef11f485-5e')
Nov 16 18:06:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:06:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No VIF found with MAC fa:16:3e:f6:4b:12, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:06:26 user nova-compute[75342]: INFO nova.compute.manager [None req-bbd39ed1-c586-4373-ae52-17de96be3bb9 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Unrescuing
Nov 16 18:06:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bbd39ed1-c586-4373-ae52-17de96be3bb9 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:06:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bbd39ed1-c586-4373-ae52-17de96be3bb9 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquired lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:06:26 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bbd39ed1-c586-4373-ae52-17de96be3bb9 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bbd39ed1-c586-4373-ae52-17de96be3bb9 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Updating instance_info_cache with network_info: [{"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bbd39ed1-c586-4373-ae52-17de96be3bb9 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Releasing lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG nova.objects.instance [None req-bbd39ed1-c586-4373-ae52-17de96be3bb9 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'flavor' on Instance uuid 78afab8c-3e7c-4697-86b8-726c6ed252c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG nova.compute.manager [req-45469031-589e-401b-8d92-928b105c9f5e req-2939e2a6-4ed1-4217-a617-2fa04171dce3 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Received event network-vif-plugged-ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-45469031-589e-401b-8d92-928b105c9f5e req-2939e2a6-4ed1-4217-a617-2fa04171dce3 service nova] Acquiring lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-45469031-589e-401b-8d92-928b105c9f5e req-2939e2a6-4ed1-4217-a617-2fa04171dce3 service nova] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-45469031-589e-401b-8d92-928b105c9f5e req-2939e2a6-4ed1-4217-a617-2fa04171dce3 service nova] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG nova.compute.manager [req-45469031-589e-401b-8d92-928b105c9f5e req-2939e2a6-4ed1-4217-a617-2fa04171dce3 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] No waiting events found dispatching network-vif-plugged-ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:27 user nova-compute[75342]: WARNING nova.compute.manager [req-45469031-589e-401b-8d92-928b105c9f5e req-2939e2a6-4ed1-4217-a617-2fa04171dce3 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Received unexpected event network-vif-plugged-ef11f485-5e98-470a-b000-44ce8fb72863 for instance with vm_state building and task_state spawning.
Nov 16 18:06:27 user nova-compute[75342]: DEBUG nova.compute.manager [req-0c381369-e261-4512-abc2-326871821c46 req-bffe9ac4-3b56-40f2-9a9f-30238f8e0617 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-unplugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0c381369-e261-4512-abc2-326871821c46 req-bffe9ac4-3b56-40f2-9a9f-30238f8e0617 service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0c381369-e261-4512-abc2-326871821c46 req-bffe9ac4-3b56-40f2-9a9f-30238f8e0617 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0c381369-e261-4512-abc2-326871821c46 req-bffe9ac4-3b56-40f2-9a9f-30238f8e0617 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG nova.compute.manager [req-0c381369-e261-4512-abc2-326871821c46 req-bffe9ac4-3b56-40f2-9a9f-30238f8e0617 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-unplugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:27 user nova-compute[75342]: WARNING nova.compute.manager [req-0c381369-e261-4512-abc2-326871821c46 req-bffe9ac4-3b56-40f2-9a9f-30238f8e0617 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received unexpected event network-vif-unplugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:06:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Instance destroyed successfully.
Nov 16 18:06:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-61e0dc4f-6cf0-49fd-bd00-a4be050ceff1 req-72895a29-5e4f-4fc9-b817-31a5d8154e04 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Received event network-vif-plugged-ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-61e0dc4f-6cf0-49fd-bd00-a4be050ceff1 req-72895a29-5e4f-4fc9-b817-31a5d8154e04 service nova] Acquiring lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-61e0dc4f-6cf0-49fd-bd00-a4be050ceff1 req-72895a29-5e4f-4fc9-b817-31a5d8154e04 service nova] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-61e0dc4f-6cf0-49fd-bd00-a4be050ceff1 req-72895a29-5e4f-4fc9-b817-31a5d8154e04 service nova] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-61e0dc4f-6cf0-49fd-bd00-a4be050ceff1 req-72895a29-5e4f-4fc9-b817-31a5d8154e04 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] No waiting events found dispatching network-vif-plugged-ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:29 user nova-compute[75342]: WARNING nova.compute.manager [req-61e0dc4f-6cf0-49fd-bd00-a4be050ceff1 req-72895a29-5e4f-4fc9-b817-31a5d8154e04 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Received unexpected event network-vif-plugged-ef11f485-5e98-470a-b000-44ce8fb72863 for instance with vm_state building and task_state spawning.
Nov 16 18:06:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:29 user nova-compute[75342]: WARNING nova.compute.manager [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received unexpected event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:29 user nova-compute[75342]: WARNING nova.compute.manager [req-9ca9dec9-da40-40de-abc8-508cb7a1018b req-1057449a-b3d1-47e2-b348-f92c9150fc50 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received unexpected event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.compute.manager [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:06:29 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Instance spawned successfully.
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:29 user nova-compute[75342]: INFO nova.compute.manager [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 16 18:06:29 user nova-compute[75342]: DEBUG nova.compute.manager [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:06:29 user nova-compute[75342]: INFO nova.compute.manager [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Took 17.53 seconds to build instance.
Nov 16 18:06:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86992fcc-1a53-48de-b856-cf41f68860bf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.643s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bbd39ed1-c586-4373-ae52-17de96be3bb9 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:06:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-a8f36d22-8d0f-44f0-8431-117067fc3484 req-8b435621-84b7-4e4e-b499-8abd1c81ae0f service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a8f36d22-8d0f-44f0-8431-117067fc3484 req-8b435621-84b7-4e4e-b499-8abd1c81ae0f service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a8f36d22-8d0f-44f0-8431-117067fc3484 req-8b435621-84b7-4e4e-b499-8abd1c81ae0f service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a8f36d22-8d0f-44f0-8431-117067fc3484 req-8b435621-84b7-4e4e-b499-8abd1c81ae0f service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-a8f36d22-8d0f-44f0-8431-117067fc3484 req-8b435621-84b7-4e4e-b499-8abd1c81ae0f service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:31 user nova-compute[75342]: WARNING nova.compute.manager [req-a8f36d22-8d0f-44f0-8431-117067fc3484 req-8b435621-84b7-4e4e-b499-8abd1c81ae0f service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received unexpected event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with vm_state active and task_state None.
Nov 16 18:06:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:06:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:06:35 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:06:35 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:06:35 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:06:35 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:06:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:06:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:37 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:06:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:06:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:06:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:06:42 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:06:42 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7094MB free_disk=25.259567260742188GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 2992b5fc-86e6-425f-82e5-cf6358582872 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c6408c85-ed86-4b11-afa6-14f93b92492c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c35a34d1-db34-4e60-ac54-cb22aa1a9079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d7c1a9b7-9251-4d6e-ae82-5176535eb9eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9b8d894f-9e43-4745-8a22-dc368a472320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:06:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:06:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:06:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:06:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:06:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:06:43 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:06:43 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 85cd3e12-187f-48ba-9753-e8e93787cdf4 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:06:44 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updating instance_info_cache with network_info: [{"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:06:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:06:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:06:44 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:06:44 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:06:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:06:48 user nova-compute[75342]: INFO nova.compute.claims [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Claim successful on node user
Nov 16 18:06:48 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:06:48 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:06:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG nova.policy [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1da0d585d0e04be284e3eb50ce093d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7dafce5e534279b01a17644c620e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:06:48 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Creating image(s)
Nov 16 18:06:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "/opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "/opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "/opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.167s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk 1073741824" returned: 0 in 0.052s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Successfully created port: 326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Cannot resize image /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Ensure instance console log exists: /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Successfully updated port: 326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquired lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-cf099d48-4648-4729-a766-8c4f8462a44b req-968838e3-2c2f-49e3-b747-811886d3a437 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-changed-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-cf099d48-4648-4729-a766-8c4f8462a44b req-968838e3-2c2f-49e3-b747-811886d3a437 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Refreshing instance network info cache due to event network-changed-326f6a9c-1559-4846-b2df-cb6b8ac9eed9. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cf099d48-4648-4729-a766-8c4f8462a44b req-968838e3-2c2f-49e3-b747-811886d3a437 service nova] Acquiring lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Updating instance_info_cache with network_info: [{"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Releasing lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance network_info: |[{"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cf099d48-4648-4729-a766-8c4f8462a44b req-968838e3-2c2f-49e3-b747-811886d3a437 service nova] Acquired lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.network.neutron [req-cf099d48-4648-4729-a766-8c4f8462a44b req-968838e3-2c2f-49e3-b747-811886d3a437 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Refreshing network info cache for port 326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Start _get_guest_xml network_info=[{"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:06:50 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:06:50 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2074580807',display_name='tempest-AttachVolumeTestJSON-server-2074580807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2074580807',id=25,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPFfdYGYtdfUwjEiOE/iwsDZ8HxFnxrUjMrOXe3mcWU8NAzXmZ0SHoyGfYP5VBo3S4o53/E3MwQVBkBzuKmzbRAXUrMsihBETp/TApLvk6647LfkR70K66wWqQJP/b4A==',key_name='tempest-keypair-1267583389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-pms15lgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=361ee32d-4ad3-4bd3-bdf9-6fd404d0f297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.objects.instance [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'pci_devices' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:06:50 user nova-compute[75342]:   <uuid>361ee32d-4ad3-4bd3-bdf9-6fd404d0f297</uuid>
Nov 16 18:06:50 user nova-compute[75342]:   <name>instance-00000019</name>
Nov 16 18:06:50 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:06:50 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:06:50 user nova-compute[75342]:   <metadata>
Nov 16 18:06:50 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:06:50 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:06:50 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeTestJSON-server-2074580807</nova:name>
Nov 16 18:06:50 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:06:50</nova:creationTime>
Nov 16 18:06:50 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:06:50 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:06:50 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:06:50 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:06:50 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:06:50 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:06:50 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:06:50 user nova-compute[75342]:       <nova:owner>
Nov 16 18:06:50 user nova-compute[75342]:         <nova:user uuid="1da0d585d0e04be284e3eb50ce093d89">tempest-AttachVolumeTestJSON-410390487-project-member</nova:user>
Nov 16 18:06:50 user nova-compute[75342]:         <nova:project uuid="6b7dafce5e534279b01a17644c620e36">tempest-AttachVolumeTestJSON-410390487</nova:project>
Nov 16 18:06:50 user nova-compute[75342]:       </nova:owner>
Nov 16 18:06:50 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:06:50 user nova-compute[75342]:       <nova:ports>
Nov 16 18:06:50 user nova-compute[75342]:         <nova:port uuid="326f6a9c-1559-4846-b2df-cb6b8ac9eed9">
Nov 16 18:06:50 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 18:06:50 user nova-compute[75342]:         </nova:port>
Nov 16 18:06:50 user nova-compute[75342]:       </nova:ports>
Nov 16 18:06:50 user nova-compute[75342]:     </nova:instance>
Nov 16 18:06:50 user nova-compute[75342]:   </metadata>
Nov 16 18:06:50 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:06:50 user nova-compute[75342]:     <system>
Nov 16 18:06:50 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:06:50 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:06:50 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:06:50 user nova-compute[75342]:       <entry name="serial">361ee32d-4ad3-4bd3-bdf9-6fd404d0f297</entry>
Nov 16 18:06:50 user nova-compute[75342]:       <entry name="uuid">361ee32d-4ad3-4bd3-bdf9-6fd404d0f297</entry>
Nov 16 18:06:50 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:06:50 user nova-compute[75342]:     </system>
Nov 16 18:06:50 user nova-compute[75342]:   </sysinfo>
Nov 16 18:06:50 user nova-compute[75342]:   <os>
Nov 16 18:06:50 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:06:50 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:06:50 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:06:50 user nova-compute[75342]:   </os>
Nov 16 18:06:50 user nova-compute[75342]:   <features>
Nov 16 18:06:50 user nova-compute[75342]:     <acpi/>
Nov 16 18:06:50 user nova-compute[75342]:     <apic/>
Nov 16 18:06:50 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:06:50 user nova-compute[75342]:   </features>
Nov 16 18:06:50 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:06:50 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:06:50 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:06:50 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:06:50 user nova-compute[75342]:   </clock>
Nov 16 18:06:50 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:06:50 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:06:50 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:06:50 user nova-compute[75342]:   </cpu>
Nov 16 18:06:50 user nova-compute[75342]:   <devices>
Nov 16 18:06:50 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:06:50 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:06:50 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk"/>
Nov 16 18:06:50 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:06:50 user nova-compute[75342]:     </disk>
Nov 16 18:06:50 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:06:50 user nova-compute[75342]:       <mac address="fa:16:3e:3f:c1:5a"/>
Nov 16 18:06:50 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:06:50 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:06:50 user nova-compute[75342]:       <target dev="tap326f6a9c-15"/>
Nov 16 18:06:50 user nova-compute[75342]:     </interface>
Nov 16 18:06:50 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:06:50 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/console.log" append="off"/>
Nov 16 18:06:50 user nova-compute[75342]:     </serial>
Nov 16 18:06:50 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:06:50 user nova-compute[75342]:     <video>
Nov 16 18:06:50 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:06:50 user nova-compute[75342]:     </video>
Nov 16 18:06:50 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:06:50 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:06:50 user nova-compute[75342]:     </rng>
Nov 16 18:06:50 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:06:50 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:06:50 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:06:50 user nova-compute[75342]:     </memballoon>
Nov 16 18:06:50 user nova-compute[75342]:   </devices>
Nov 16 18:06:50 user nova-compute[75342]: </domain>
Nov 16 18:06:50 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2074580807',display_name='tempest-AttachVolumeTestJSON-server-2074580807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2074580807',id=25,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPFfdYGYtdfUwjEiOE/iwsDZ8HxFnxrUjMrOXe3mcWU8NAzXmZ0SHoyGfYP5VBo3S4o53/E3MwQVBkBzuKmzbRAXUrMsihBETp/TApLvk6647LfkR70K66wWqQJP/b4A==',key_name='tempest-keypair-1267583389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-pms15lgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=361ee32d-4ad3-4bd3-bdf9-6fd404d0f297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG os_vif [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43d5eb76-b0c2-5a18-acfb-a6d02ddba571', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap326f6a9c-15, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap326f6a9c-15, col_values=(('qos', UUID('6399619a-a3a0-4c5b-b887-2ba130d546a0')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap326f6a9c-15, col_values=(('external_ids', {'iface-id': '326f6a9c-1559-4846-b2df-cb6b8ac9eed9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:c1:5a', 'vm-uuid': '361ee32d-4ad3-4bd3-bdf9-6fd404d0f297'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:50 user nova-compute[75342]: INFO os_vif [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15')
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:06:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No VIF found with MAC fa:16:3e:3f:c1:5a, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:06:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-cf099d48-4648-4729-a766-8c4f8462a44b req-968838e3-2c2f-49e3-b747-811886d3a437 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Updated VIF entry in instance network info cache for port 326f6a9c-1559-4846-b2df-cb6b8ac9eed9. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:06:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-cf099d48-4648-4729-a766-8c4f8462a44b req-968838e3-2c2f-49e3-b747-811886d3a437 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Updating instance_info_cache with network_info: [{"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:06:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cf099d48-4648-4729-a766-8c4f8462a44b req-968838e3-2c2f-49e3-b747-811886d3a437 service nova] Releasing lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:06:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-2f5b96bc-fe3f-42ad-ab89-0a129965fca8 req-2ebcde8e-eef2-4b61-9040-9a64f40aa58b service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f5b96bc-fe3f-42ad-ab89-0a129965fca8 req-2ebcde8e-eef2-4b61-9040-9a64f40aa58b service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f5b96bc-fe3f-42ad-ab89-0a129965fca8 req-2ebcde8e-eef2-4b61-9040-9a64f40aa58b service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2f5b96bc-fe3f-42ad-ab89-0a129965fca8 req-2ebcde8e-eef2-4b61-9040-9a64f40aa58b service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-2f5b96bc-fe3f-42ad-ab89-0a129965fca8 req-2ebcde8e-eef2-4b61-9040-9a64f40aa58b service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:52 user nova-compute[75342]: WARNING nova.compute.manager [req-2f5b96bc-fe3f-42ad-ab89-0a129965fca8 req-2ebcde8e-eef2-4b61-9040-9a64f40aa58b service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received unexpected event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with vm_state building and task_state spawning.
Nov 16 18:06:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:06:54 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance spawned successfully.
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:06:54 user nova-compute[75342]: INFO nova.compute.manager [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-d4431b26-9d42-47c9-9c2a-fb4133850d56 req-09700a4e-5858-4eec-abe6-e539fbac2f7c service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d4431b26-9d42-47c9-9c2a-fb4133850d56 req-09700a4e-5858-4eec-abe6-e539fbac2f7c service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d4431b26-9d42-47c9-9c2a-fb4133850d56 req-09700a4e-5858-4eec-abe6-e539fbac2f7c service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d4431b26-9d42-47c9-9c2a-fb4133850d56 req-09700a4e-5858-4eec-abe6-e539fbac2f7c service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-d4431b26-9d42-47c9-9c2a-fb4133850d56 req-09700a4e-5858-4eec-abe6-e539fbac2f7c service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:06:54 user nova-compute[75342]: WARNING nova.compute.manager [req-d4431b26-9d42-47c9-9c2a-fb4133850d56 req-09700a4e-5858-4eec-abe6-e539fbac2f7c service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received unexpected event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with vm_state building and task_state spawning.
Nov 16 18:06:54 user nova-compute[75342]: INFO nova.compute.manager [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Took 6.16 seconds to build instance.
Nov 16 18:06:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1f64bb9-0bc5-4cfc-aa67-ee8c9340b006 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.256s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:06:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:06:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:07:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:07:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:07:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:07:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:32 user nova-compute[75342]: INFO nova.compute.manager [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Terminating instance
Nov 16 18:07:32 user nova-compute[75342]: DEBUG nova.compute.manager [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:07:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-d59a31e4-0114-4b9a-b217-82db63600153 req-0e939ed9-7689-43f1-b677-272053720f88 service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Received event network-vif-unplugged-89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d59a31e4-0114-4b9a-b217-82db63600153 req-0e939ed9-7689-43f1-b677-272053720f88 service nova] Acquiring lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d59a31e4-0114-4b9a-b217-82db63600153 req-0e939ed9-7689-43f1-b677-272053720f88 service nova] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d59a31e4-0114-4b9a-b217-82db63600153 req-0e939ed9-7689-43f1-b677-272053720f88 service nova] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-d59a31e4-0114-4b9a-b217-82db63600153 req-0e939ed9-7689-43f1-b677-272053720f88 service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] No waiting events found dispatching network-vif-unplugged-89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-d59a31e4-0114-4b9a-b217-82db63600153 req-0e939ed9-7689-43f1-b677-272053720f88 service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Received event network-vif-unplugged-89dc167c-d215-4c26-84ca-f96fb075a578 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Instance destroyed successfully.
Nov 16 18:07:33 user nova-compute[75342]: DEBUG nova.objects.instance [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lazy-loading 'resources' on Instance uuid c35a34d1-db34-4e60-ac54-cb22aa1a9079 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-301313553',display_name='tempest-ServersNegativeTestJSON-server-301313553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-301313553',id=21,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c366b0f382394d26a46a902606d1b860',ramdisk_id='',reservation_id='r-42jo5nml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1517580992',owner_user_name='tempest-ServersNegativeTestJSON-1517580992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:05:52Z,user_data=None,user_id='520c2ec376be46aaabcc5ca1c7aa831c',uuid=c35a34d1-db34-4e60-ac54-cb22aa1a9079,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89dc167c-d215-4c26-84ca-f96fb075a578", "address": "fa:16:3e:5d:53:cf", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc167c-d2", "ovs_interfaceid": "89dc167c-d215-4c26-84ca-f96fb075a578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converting VIF {"id": "89dc167c-d215-4c26-84ca-f96fb075a578", "address": "fa:16:3e:5d:53:cf", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89dc167c-d2", "ovs_interfaceid": "89dc167c-d215-4c26-84ca-f96fb075a578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:53:cf,bridge_name='br-int',has_traffic_filtering=True,id=89dc167c-d215-4c26-84ca-f96fb075a578,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc167c-d2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG os_vif [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:53:cf,bridge_name='br-int',has_traffic_filtering=True,id=89dc167c-d215-4c26-84ca-f96fb075a578,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc167c-d2') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89dc167c-d2, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15a8abfd-83ba-48a5-8391-292d7f046818) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:33 user nova-compute[75342]: INFO os_vif [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:53:cf,bridge_name='br-int',has_traffic_filtering=True,id=89dc167c-d215-4c26-84ca-f96fb075a578,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89dc167c-d2')
Nov 16 18:07:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Deleting instance files /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079_del
Nov 16 18:07:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Deletion of /opt/stack/data/nova/instances/c35a34d1-db34-4e60-ac54-cb22aa1a9079_del complete
Nov 16 18:07:33 user nova-compute[75342]: INFO nova.compute.manager [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 16 18:07:33 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:07:33 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Took 0.41 seconds to deallocate network for instance.
Nov 16 18:07:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-7462d185-e73d-4544-8547-a386453aa23b req-7a66e2ee-6441-48e8-9c48-324cce2fc34c service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Received event network-vif-deleted-89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:07:34 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:07:34 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:07:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:34 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Deleted allocations for instance c35a34d1-db34-4e60-ac54-cb22aa1a9079
Nov 16 18:07:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4bfafb0d-b9d1-4396-ae9a-6ff0ef6a6837 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.868s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-ba62ef8f-27ce-4f52-98bd-7a2730897e69 req-883b5bc8-e7ef-4a8f-a61c-6ec12688e37f service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Received event network-vif-plugged-89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:07:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ba62ef8f-27ce-4f52-98bd-7a2730897e69 req-883b5bc8-e7ef-4a8f-a61c-6ec12688e37f service nova] Acquiring lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ba62ef8f-27ce-4f52-98bd-7a2730897e69 req-883b5bc8-e7ef-4a8f-a61c-6ec12688e37f service nova] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ba62ef8f-27ce-4f52-98bd-7a2730897e69 req-883b5bc8-e7ef-4a8f-a61c-6ec12688e37f service nova] Lock "c35a34d1-db34-4e60-ac54-cb22aa1a9079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-ba62ef8f-27ce-4f52-98bd-7a2730897e69 req-883b5bc8-e7ef-4a8f-a61c-6ec12688e37f service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] No waiting events found dispatching network-vif-plugged-89dc167c-d215-4c26-84ca-f96fb075a578 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:07:35 user nova-compute[75342]: WARNING nova.compute.manager [req-ba62ef8f-27ce-4f52-98bd-7a2730897e69 req-883b5bc8-e7ef-4a8f-a61c-6ec12688e37f service nova] [instance: c35a34d1-db34-4e60-ac54-cb22aa1a9079] Received unexpected event network-vif-plugged-89dc167c-d215-4c26-84ca-f96fb075a578 for instance with vm_state deleted and task_state None.
Nov 16 18:07:35 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:07:35 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:07:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:07:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:07:37 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-42240853-0718-4369-a6f3-8632356d4ad1 req-696231a9-3a57-4f31-9a9e-018a19b24a95 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Received event network-changed-258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-42240853-0718-4369-a6f3-8632356d4ad1 req-696231a9-3a57-4f31-9a9e-018a19b24a95 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Refreshing instance network info cache due to event network-changed-258320a2-30f7-4c04-bb9f-49a4caa90b3f. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-42240853-0718-4369-a6f3-8632356d4ad1 req-696231a9-3a57-4f31-9a9e-018a19b24a95 service nova] Acquiring lock "refresh_cache-218bd8cd-58a5-40b3-a989-5aea6a5c9c43" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-42240853-0718-4369-a6f3-8632356d4ad1 req-696231a9-3a57-4f31-9a9e-018a19b24a95 service nova] Acquired lock "refresh_cache-218bd8cd-58a5-40b3-a989-5aea6a5c9c43" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG nova.network.neutron [req-42240853-0718-4369-a6f3-8632356d4ad1 req-696231a9-3a57-4f31-9a9e-018a19b24a95 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Refreshing network info cache for port 258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG nova.network.neutron [req-42240853-0718-4369-a6f3-8632356d4ad1 req-696231a9-3a57-4f31-9a9e-018a19b24a95 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Updated VIF entry in instance network info cache for port 258320a2-30f7-4c04-bb9f-49a4caa90b3f. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG nova.network.neutron [req-42240853-0718-4369-a6f3-8632356d4ad1 req-696231a9-3a57-4f31-9a9e-018a19b24a95 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Updating instance_info_cache with network_info: [{"id": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "address": "fa:16:3e:c5:f5:ba", "network": {"id": "84a047a1-f39f-4ca6-a9db-6cc532a1d632", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1681619625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d165c413794047efaea43b92a124f937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258320a2-30", "ovs_interfaceid": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-42240853-0718-4369-a6f3-8632356d4ad1 req-696231a9-3a57-4f31-9a9e-018a19b24a95 service nova] Releasing lock "refresh_cache-218bd8cd-58a5-40b3-a989-5aea6a5c9c43" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:07:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG nova.objects.instance [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lazy-loading 'flavor' on Instance uuid 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:42 user nova-compute[75342]: INFO nova.compute.manager [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Attaching volume c8d9201f-91db-4746-971d-22b1dca0f8a4 to /dev/vdb
Nov 16 18:07:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG os_brick.utils [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:43 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:07:43 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7115MB free_disk=25.227542877197266GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6fc505-8850-4cd6-8db3-73437cef81e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:43 user nova-compute[75342]: INFO nova.compute.manager [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Rescuing
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquired lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.network.neutron [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc00d96a-169f-4347-8db3-7d1f761b49c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f43b31-3d15-4176-bab7-c8dc8b896efb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ec168-2e29-412f-96df-ff3a3c5ed07a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:07:43 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b46489f-1ce5-48bb-9c5d-dcb99d3c9fdf]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG os_brick.utils [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Updating existing volume attachment record: 44fd0975-0b9d-422e-96de-0ad53b8778f3 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 2992b5fc-86e6-425f-82e5-cf6358582872 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c6408c85-ed86-4b11-afa6-14f93b92492c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d7c1a9b7-9251-4d6e-ae82-5176535eb9eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9b8d894f-9e43-4745-8a22-dc368a472320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.network.neutron [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Updating instance_info_cache with network_info: [{"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Releasing lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-2dc02529-ca32-4329-963d-21969deadcff req-83dbdfe0-99b0-4325-b98e-51c8b79717d8 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-unplugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2dc02529-ca32-4329-963d-21969deadcff req-83dbdfe0-99b0-4325-b98e-51c8b79717d8 service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2dc02529-ca32-4329-963d-21969deadcff req-83dbdfe0-99b0-4325-b98e-51c8b79717d8 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2dc02529-ca32-4329-963d-21969deadcff req-83dbdfe0-99b0-4325-b98e-51c8b79717d8 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-2dc02529-ca32-4329-963d-21969deadcff req-83dbdfe0-99b0-4325-b98e-51c8b79717d8 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-unplugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:07:44 user nova-compute[75342]: WARNING nova.compute.manager [req-2dc02529-ca32-4329-963d-21969deadcff req-83dbdfe0-99b0-4325-b98e-51c8b79717d8 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received unexpected event network-vif-unplugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with vm_state active and task_state rescuing.
Nov 16 18:07:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Instance destroyed successfully.
Nov 16 18:07:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Attempting rescue
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75342) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Instance directory exists: not creating {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 18:07:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Creating image(s)
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.objects.instance [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'trusted_certs' on Instance uuid d0385123-12ff-41a3-a78d-ac5ce325ae0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.rescue {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.rescue" returned: 0 in 0.047s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.objects.instance [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'migration_context' on Instance uuid d0385123-12ff-41a3-a78d-ac5ce325ae0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.objects.base [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<d0385123-12ff-41a3-a78d-ac5ce325ae0d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Start _get_guest_xml network_info=[{"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "vif_mac": "fa:16:3e:f5:53:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.objects.instance [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'resources' on Instance uuid d0385123-12ff-41a3-a78d-ac5ce325ae0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.objects.base [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<d0385123-12ff-41a3-a78d-ac5ce325ae0d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.objects.instance [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'numa_topology' on Instance uuid d0385123-12ff-41a3-a78d-ac5ce325ae0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.objects.base [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<d0385123-12ff-41a3-a78d-ac5ce325ae0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:07:44 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:07:44 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.objects.instance [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'vcpu_model' on Instance uuid d0385123-12ff-41a3-a78d-ac5ce325ae0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.objects.base [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<d0385123-12ff-41a3-a78d-ac5ce325ae0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1931076852',display_name='tempest-ServerRescueNegativeTestJSON-server-1931076852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1931076852',id=15,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:03:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-aaovrqtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:03:08Z,user_data=None,user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=d0385123-12ff-41a3-a78d-ac5ce325ae0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "vif_mac": "fa:16:3e:f5:53:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "vif_mac": "fa:16:3e:f5:53:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:53:c1,bridge_name='br-int',has_traffic_filtering=True,id=5790346b-5f12-43ca-8348-7401eff36734,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5790346b-5f') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.objects.instance [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'pci_devices' on Instance uuid d0385123-12ff-41a3-a78d-ac5ce325ae0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.objects.base [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<d0385123-12ff-41a3-a78d-ac5ce325ae0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:07:44 user nova-compute[75342]:   <uuid>d0385123-12ff-41a3-a78d-ac5ce325ae0d</uuid>
Nov 16 18:07:44 user nova-compute[75342]:   <name>instance-0000000f</name>
Nov 16 18:07:44 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:07:44 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:07:44 user nova-compute[75342]:   <metadata>
Nov 16 18:07:44 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:07:44 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:07:44 user nova-compute[75342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1931076852</nova:name>
Nov 16 18:07:44 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:07:44</nova:creationTime>
Nov 16 18:07:44 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:07:44 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:07:44 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:07:44 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:07:44 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:07:44 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:07:44 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:07:44 user nova-compute[75342]:       <nova:owner>
Nov 16 18:07:44 user nova-compute[75342]:         <nova:user uuid="0697a15cd0054cef90459da99a3fd8ec">tempest-ServerRescueNegativeTestJSON-935902109-project-member</nova:user>
Nov 16 18:07:44 user nova-compute[75342]:         <nova:project uuid="02d87f343b6e4dbead83e037619ae49c">tempest-ServerRescueNegativeTestJSON-935902109</nova:project>
Nov 16 18:07:44 user nova-compute[75342]:       </nova:owner>
Nov 16 18:07:44 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:07:44 user nova-compute[75342]:       <nova:ports>
Nov 16 18:07:44 user nova-compute[75342]:         <nova:port uuid="5790346b-5f12-43ca-8348-7401eff36734">
Nov 16 18:07:44 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 18:07:44 user nova-compute[75342]:         </nova:port>
Nov 16 18:07:44 user nova-compute[75342]:       </nova:ports>
Nov 16 18:07:44 user nova-compute[75342]:     </nova:instance>
Nov 16 18:07:44 user nova-compute[75342]:   </metadata>
Nov 16 18:07:44 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:07:44 user nova-compute[75342]:     <system>
Nov 16 18:07:44 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:07:44 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:07:44 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:07:44 user nova-compute[75342]:       <entry name="serial">d0385123-12ff-41a3-a78d-ac5ce325ae0d</entry>
Nov 16 18:07:44 user nova-compute[75342]:       <entry name="uuid">d0385123-12ff-41a3-a78d-ac5ce325ae0d</entry>
Nov 16 18:07:44 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:07:44 user nova-compute[75342]:     </system>
Nov 16 18:07:44 user nova-compute[75342]:   </sysinfo>
Nov 16 18:07:44 user nova-compute[75342]:   <os>
Nov 16 18:07:44 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:07:44 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:07:44 user nova-compute[75342]:   </os>
Nov 16 18:07:44 user nova-compute[75342]:   <features>
Nov 16 18:07:44 user nova-compute[75342]:     <acpi/>
Nov 16 18:07:44 user nova-compute[75342]:     <apic/>
Nov 16 18:07:44 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:07:44 user nova-compute[75342]:   </features>
Nov 16 18:07:44 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:07:44 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:07:44 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:07:44 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:07:44 user nova-compute[75342]:   </clock>
Nov 16 18:07:44 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:07:44 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:07:44 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:07:44 user nova-compute[75342]:   </cpu>
Nov 16 18:07:44 user nova-compute[75342]:   <devices>
Nov 16 18:07:44 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:07:44 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:07:44 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.rescue"/>
Nov 16 18:07:44 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:07:44 user nova-compute[75342]:     </disk>
Nov 16 18:07:44 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:07:44 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:07:44 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk"/>
Nov 16 18:07:44 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:07:44 user nova-compute[75342]:     </disk>
Nov 16 18:07:44 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:07:44 user nova-compute[75342]:       <mac address="fa:16:3e:f5:53:c1"/>
Nov 16 18:07:44 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:07:44 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:07:44 user nova-compute[75342]:       <target dev="tap5790346b-5f"/>
Nov 16 18:07:44 user nova-compute[75342]:     </interface>
Nov 16 18:07:44 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:07:44 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/console.log" append="off"/>
Nov 16 18:07:44 user nova-compute[75342]:     </serial>
Nov 16 18:07:44 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:07:44 user nova-compute[75342]:     <video>
Nov 16 18:07:44 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:07:44 user nova-compute[75342]:     </video>
Nov 16 18:07:44 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:07:44 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:07:44 user nova-compute[75342]:     </rng>
Nov 16 18:07:44 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:07:44 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:07:44 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:07:44 user nova-compute[75342]:     </memballoon>
Nov 16 18:07:44 user nova-compute[75342]:   </devices>
Nov 16 18:07:44 user nova-compute[75342]: </domain>
Nov 16 18:07:44 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:07:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Instance destroyed successfully.
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No VIF found with MAC fa:16:3e:f5:53:c1, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:07:44 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:07:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Updating instance_info_cache with network_info: [{"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:07:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:07:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:07:45 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:07:45 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:07:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-a4a0b346-36f1-4493-afda-d012cd99afe0 req-39513b9b-2794-4fa4-b859-d14f3390017e service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:07:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a4a0b346-36f1-4493-afda-d012cd99afe0 req-39513b9b-2794-4fa4-b859-d14f3390017e service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a4a0b346-36f1-4493-afda-d012cd99afe0 req-39513b9b-2794-4fa4-b859-d14f3390017e service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a4a0b346-36f1-4493-afda-d012cd99afe0 req-39513b9b-2794-4fa4-b859-d14f3390017e service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-a4a0b346-36f1-4493-afda-d012cd99afe0 req-39513b9b-2794-4fa4-b859-d14f3390017e service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:07:46 user nova-compute[75342]: WARNING nova.compute.manager [req-a4a0b346-36f1-4493-afda-d012cd99afe0 req-39513b9b-2794-4fa4-b859-d14f3390017e service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received unexpected event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with vm_state active and task_state rescuing.
Nov 16 18:07:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:07:48 user nova-compute[75342]: WARNING nova.compute.manager [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received unexpected event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with vm_state active and task_state rescuing.
Nov 16 18:07:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:07:48 user nova-compute[75342]: WARNING nova.compute.manager [req-cd424fe5-f9b5-491d-a0dc-377ff2249277 req-575c7075-d7ae-4e87-8d91-dd8d1626ad53 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received unexpected event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with vm_state active and task_state rescuing.
Nov 16 18:07:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-975db41a-08f7-4ec1-bb63-503eeb3e5e89 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rInZBWei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:07:48 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:07:48 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:07:48 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0055cd53-e31c-4d53-8218-ba4dbbaae776]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:07:48 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f75136-d5dd-480b-add7-d0e1e6a1e2fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4] added
Nov 16 18:07:48 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf307261-f0c8-4bbb-8256-d9dc789cf369]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad46c581-19ec-4674-9c02-0bf18112b038]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rInZBWei {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rInZBWei" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f1ed77-e2d7-497a-90b3-a86f09b7c7fb]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rInZBWei'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed1286d-fcd0-4667-862c-c68d5cf9d57a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc6e7af-7f2f-4338-9e3f-26f088bf39c0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:07:48 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:07:48 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:07:48 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:07:48 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:07:48 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:07:48 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:07:48 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:07:48 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:07:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aa5efe-2a25-41f7-9c1b-67445043543d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4, portal: 172.16.0.220,3260]
Nov 16 18:07:49 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4, portal: 172.16.0.220,3260] successful.
Nov 16 18:07:49 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.115s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df2a2f4-224c-4e82-9935-b7ea9fbe73f0]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[570ebef5-46c4-4b61-a7b0-6bfc1613df2e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:07:49 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:07:49 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:07:49 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:07:49 user nova-compute[75342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)
Nov 16 18:07:49 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:07:49 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:07:49 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:07:49 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:07:49 user nova-compute[75342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)
Nov 16 18:07:49 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0650c6e8-26f9-4bac-b4a3-77a3d337d662]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:49 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rInZBWei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26332376139646234', 'path': '/dev/sdf'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332376139646234', 'path': '/dev/sdf'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG nova.objects.instance [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lazy-loading 'flavor' on Instance uuid 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:07:50 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:07:50 user nova-compute[75342]:   <source dev="/dev/sdf"/>
Nov 16 18:07:50 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:07:50 user nova-compute[75342]:   <serial>c8d9201f-91db-4746-971d-22b1dca0f8a4</serial>
Nov 16 18:07:50 user nova-compute[75342]: </disk>
Nov 16 18:07:50 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] No VIF found with MAC fa:16:3e:c5:f5:ba, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7fa5a844-80f2-420f-8439-6b0471ee9305 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.213s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:50 user nova-compute[75342]: INFO nova.compute.manager [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Unshelving
Nov 16 18:07:51 user nova-compute[75342]: INFO nova.virt.block_device [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Booting with volume e1508f04-5d7c-4fd6-bc91-c1c1884596e0 at /dev/vdc
Nov 16 18:07:51 user nova-compute[75342]: DEBUG os_brick.utils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e17e069-1944-4f72-8c37-efb6990c3d68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[100ac3f4-a7e3-47d1-a2f1-a1d04b0ec92d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[230a3176-5a1c-46f3-b3bd-f38329c269e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[780754d6-c1eb-47de-811e-074f070bd388]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:07:51 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:07:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba3cecb-c97d-40d9-8328-2550e4510934]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG os_brick.utils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:07:51 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updating existing volume attachment record: e7a881be-619b-411e-8488-9e37d4684bec {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:07:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:52 user nova-compute[75342]: INFO nova.compute.manager [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Detaching volume c8d9201f-91db-4746-971d-22b1dca0f8a4
Nov 16 18:07:53 user nova-compute[75342]: INFO nova.virt.block_device [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Attempting to driver detach volume c8d9201f-91db-4746-971d-22b1dca0f8a4 from mountpoint /dev/vdb
Nov 16 18:07:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Attempting to detach device vdb from instance 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:07:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:07:53 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:07:53 user nova-compute[75342]:   <source dev="/dev/sdf"/>
Nov 16 18:07:53 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:07:53 user nova-compute[75342]:   <serial>c8d9201f-91db-4746-971d-22b1dca0f8a4</serial>
Nov 16 18:07:53 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:07:53 user nova-compute[75342]: </disk>
Nov 16 18:07:53 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:07:53 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Successfully detached device vdb from instance 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 from the persistent domain config.
Nov 16 18:07:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:07:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:07:53 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:07:53 user nova-compute[75342]:   <source dev="/dev/sdf"/>
Nov 16 18:07:53 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:07:53 user nova-compute[75342]:   <serial>c8d9201f-91db-4746-971d-22b1dca0f8a4</serial>
Nov 16 18:07:53 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:07:53 user nova-compute[75342]: </disk>
Nov 16 18:07:53 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:07:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:07:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:56 user nova-compute[75342]: DEBUG nova.objects.instance [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'pci_requests' on Instance uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:56 user nova-compute[75342]: DEBUG nova.objects.instance [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'numa_topology' on Instance uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:07:56 user nova-compute[75342]: INFO nova.compute.claims [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Claim successful on node user
Nov 16 18:07:56 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:07:56 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:07:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:57 user nova-compute[75342]: INFO nova.network.neutron [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updating port 70d27952-7221-44f5-b6fb-24d3416b1b2e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 18:07:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:07:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquired lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:07:57 user nova-compute[75342]: DEBUG nova.network.neutron [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:07:57 user nova-compute[75342]: DEBUG nova.compute.manager [req-9d06c31b-c23d-45d0-a1e9-add8e3ea956d req-e1c30ee6-ada5-4506-a05b-fc6f35d6678e service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-changed-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:07:57 user nova-compute[75342]: DEBUG nova.compute.manager [req-9d06c31b-c23d-45d0-a1e9-add8e3ea956d req-e1c30ee6-ada5-4506-a05b-fc6f35d6678e service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Refreshing instance network info cache due to event network-changed-70d27952-7221-44f5-b6fb-24d3416b1b2e. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:07:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9d06c31b-c23d-45d0-a1e9-add8e3ea956d req-e1c30ee6-ada5-4506-a05b-fc6f35d6678e service nova] Acquiring lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG nova.network.neutron [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updating instance_info_cache with network_info: [{"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Releasing lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:07:58 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Creating image(s)
Nov 16 18:07:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "/opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "/opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG nova.objects.instance [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'trusted_certs' on Instance uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9d06c31b-c23d-45d0-a1e9-add8e3ea956d req-e1c30ee6-ada5-4506-a05b-fc6f35d6678e service nova] Acquired lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG nova.network.neutron [req-9d06c31b-c23d-45d0-a1e9-add8e3ea956d req-e1c30ee6-ada5-4506-a05b-fc6f35d6678e service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Refreshing network info cache for port 70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG nova.objects.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Object Instance<fb00d09d-d7c3-43f8-a118-26868011460b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "d60a34fa426b463e4124337e802a85037e01838f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "d60a34fa426b463e4124337e802a85037e01838f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:07:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:07:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f.part --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:07:59 user nova-compute[75342]: DEBUG nova.virt.images [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] c442e114-8792-494f-b052-c81603f25a78 was qcow2, converting to raw {{(pid=75342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 18:07:59 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:07:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f.part /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f.converted {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:07:59 user nova-compute[75342]: DEBUG nova.network.neutron [req-9d06c31b-c23d-45d0-a1e9-add8e3ea956d req-e1c30ee6-ada5-4506-a05b-fc6f35d6678e service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updated VIF entry in instance network info cache for port 70d27952-7221-44f5-b6fb-24d3416b1b2e. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:07:59 user nova-compute[75342]: DEBUG nova.network.neutron [req-9d06c31b-c23d-45d0-a1e9-add8e3ea956d req-e1c30ee6-ada5-4506-a05b-fc6f35d6678e service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updating instance_info_cache with network_info: [{"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9d06c31b-c23d-45d0-a1e9-add8e3ea956d req-e1c30ee6-ada5-4506-a05b-fc6f35d6678e service nova] Releasing lock "refresh_cache-fb00d09d-d7c3-43f8-a118-26868011460b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f.part /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f.converted" returned: 0 in 0.598s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f.converted --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "d60a34fa426b463e4124337e802a85037e01838f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.191s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "d60a34fa426b463e4124337e802a85037e01838f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "d60a34fa426b463e4124337e802a85037e01838f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f --force-share --output=json" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f,backing_fmt=raw /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f,backing_fmt=raw /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk 1073741824" returned: 0 in 0.052s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "d60a34fa426b463e4124337e802a85037e01838f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:01 user nova-compute[75342]: DEBUG nova.objects.instance [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'migration_context' on Instance uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:01 user nova-compute[75342]: DEBUG nova.objects.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Object Instance<fb00d09d-d7c3-43f8-a118-26868011460b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:08:01 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Rebasing disk image.
Nov 16 18:08:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d -F raw /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d -F raw /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk" returned: 0 in 2.010s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Ensure instance console log exists: /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Start _get_guest_xml network_info=[{"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='4c441e7a464673898398ca4931a79aa4',container_format='bare',created_at=2023-11-16T18:05:58Z,direct_url=<?>,disk_format='qcow2',id=c442e114-8792-494f-b052-c81603f25a78,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-539067305-shelved',owner='2b314838880c4cf68c74b2a215fa0a78',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T18:06:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e7a881be-619b-411e-8488-9e37d4684bec', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etgwqFpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'fb00d09d-d7c3-43f8-a118-26868011460b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1508f04-5d7c-4fd6-bc91-c1c1884596e0', 'serial': 'e1508f04-5d7c-4fd6-bc91-c1c1884596e0'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:08:03 user nova-compute[75342]: INFO nova.compute.manager [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Terminating instance
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:08:03 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:08:03 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4c441e7a464673898398ca4931a79aa4',container_format='bare',created_at=2023-11-16T18:05:58Z,direct_url=<?>,disk_format='qcow2',id=c442e114-8792-494f-b052-c81603f25a78,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-539067305-shelved',owner='2b314838880c4cf68c74b2a215fa0a78',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T18:06:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.objects.instance [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.objects.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Object Instance<fb00d09d-d7c3-43f8-a118-26868011460b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etgwqFpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:08:03 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:08:03 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:08:03 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f451b627-7e2a-4678-902f-5785df849a4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:08:03 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b43c2a2-ed01-4b30-8ff7-9aaa857e620c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0] added
Nov 16 18:08:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[262efb66-f4ec-4668-a322-6232aa57f747]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e9536a-7963-443d-8309-586b0eb1157f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etgwqFpz {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etgwqFpz" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3830d390-bdbf-48b4-99ec-d0e626b81232]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etgwqFpz'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cdee0b-f419-4bc6-b648-1bc026204a1f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa27255-43f6-4f0b-bd58-fbe403973140]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-f3112aad-014e-4286-9cee-d2692318ee68 req-40df391c-40fc-4bc8-a933-da499c5e3731 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Received event network-vif-unplugged-ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f3112aad-014e-4286-9cee-d2692318ee68 req-40df391c-40fc-4bc8-a933-da499c5e3731 service nova] Acquiring lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f3112aad-014e-4286-9cee-d2692318ee68 req-40df391c-40fc-4bc8-a933-da499c5e3731 service nova] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f3112aad-014e-4286-9cee-d2692318ee68 req-40df391c-40fc-4bc8-a933-da499c5e3731 service nova] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-f3112aad-014e-4286-9cee-d2692318ee68 req-40df391c-40fc-4bc8-a933-da499c5e3731 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] No waiting events found dispatching network-vif-unplugged-ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-f3112aad-014e-4286-9cee-d2692318ee68 req-40df391c-40fc-4bc8-a933-da499c5e3731 service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Received event network-vif-unplugged-ef11f485-5e98-470a-b000-44ce8fb72863 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f22469-a5d0-437d-990d-6c077aae5b42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0, portal: 172.16.0.220,3260]
Nov 16 18:08:03 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0, portal: 172.16.0.220,3260] successful.
Nov 16 18:08:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5c8412-5315-4b94-a04f-820a464623fd]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d918944-bbf7-4e62-9208-0a9bb8f30fe9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.181s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bbd752-f3ec-4d5f-bbc8-b6cc1574795f]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:08:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etgwqFpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:08:04 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Instance destroyed successfully.
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.objects.instance [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'resources' on Instance uuid d7c1a9b7-9251-4d6e-ae82-5176535eb9eb {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1326851804',display_name='tempest-TestVolumeBootPattern-server-1326851804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1326851804',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:06:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-2316l0od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:06:30Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=d7c1a9b7-9251-4d6e-ae82-5176535eb9eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef11f485-5e98-470a-b000-44ce8fb72863", "address": "fa:16:3e:f6:4b:12", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef11f485-5e", "ovs_interfaceid": "ef11f485-5e98-470a-b000-44ce8fb72863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "ef11f485-5e98-470a-b000-44ce8fb72863", "address": "fa:16:3e:f6:4b:12", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef11f485-5e", "ovs_interfaceid": "ef11f485-5e98-470a-b000-44ce8fb72863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:4b:12,bridge_name='br-int',has_traffic_filtering=True,id=ef11f485-5e98-470a-b000-44ce8fb72863,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef11f485-5e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_vif [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:4b:12,bridge_name='br-int',has_traffic_filtering=True,id=ef11f485-5e98-470a-b000-44ce8fb72863,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef11f485-5e') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef11f485-5e, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58d0be51-a7ed-49ce-9f75-12e76e6d20f0) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:08:04 user nova-compute[75342]: INFO os_vif [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:4b:12,bridge_name='br-int',has_traffic_filtering=True,id=ef11f485-5e98-470a-b000-44ce8fb72863,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef11f485-5e')
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUKWbEwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:08:04 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.544s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] <== connect_volume: return (1546ms) {'type': 'block', 'scsi_wwn': '23266386231326431', 'path': '/dev/sdg'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266386231326431', 'path': '/dev/sdg'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.660s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539067305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539067305',id=19,image_ref='c442e114-8792-494f-b052-c81603f25a78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-279505456',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-4tz76pmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member',shelved_at='2023-11-16T18:06:04.458438',shelved_host='user',shelved_image_id='c442e114-8792-494f-b052-c81603f25a78'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=fb00d09d-d7c3-43f8-a118-26868011460b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.objects.instance [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'pci_devices' on Instance uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce6cccf-d878-4db5-856b-33700aaf7cf1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:08:04 user nova-compute[75342]: No targets found.
Nov 16 18:08:04 user nova-compute[75342]: iSNS:
Nov 16 18:08:04 user nova-compute[75342]: No targets found.
Nov 16 18:08:04 user nova-compute[75342]: STATIC:
Nov 16 18:08:04 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be
Nov 16 18:08:04 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:04 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:04 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd
Nov 16 18:08:04 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:04 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:04 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:08:04 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:04 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:04 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439
Nov 16 18:08:04 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:04 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:04 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4
Nov 16 18:08:04 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:04 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:04 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0
Nov 16 18:08:04 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:04 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:04 user nova-compute[75342]: FIRMWARE:
Nov 16 18:08:04 user nova-compute[75342]: No targets found.
Nov 16 18:08:04 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:08:04 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:08:04 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.objects.base [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Object Instance<fb00d09d-d7c3-43f8-a118-26868011460b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:08:04 user nova-compute[75342]:   <uuid>fb00d09d-d7c3-43f8-a118-26868011460b</uuid>
Nov 16 18:08:04 user nova-compute[75342]:   <name>instance-00000013</name>
Nov 16 18:08:04 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:08:04 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:08:04 user nova-compute[75342]:   <metadata>
Nov 16 18:08:04 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:08:04 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:08:04 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-539067305</nova:name>
Nov 16 18:08:04 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:08:03</nova:creationTime>
Nov 16 18:08:04 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:08:04 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:08:04 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:08:04 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:08:04 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:08:04 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:08:04 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:08:04 user nova-compute[75342]:       <nova:owner>
Nov 16 18:08:04 user nova-compute[75342]:         <nova:user uuid="5976cde7fade404fac5146e3952cc95f">tempest-AttachVolumeShelveTestJSON-1298817282-project-member</nova:user>
Nov 16 18:08:04 user nova-compute[75342]:         <nova:project uuid="2b314838880c4cf68c74b2a215fa0a78">tempest-AttachVolumeShelveTestJSON-1298817282</nova:project>
Nov 16 18:08:04 user nova-compute[75342]:       </nova:owner>
Nov 16 18:08:04 user nova-compute[75342]:       <nova:root type="image" uuid="c442e114-8792-494f-b052-c81603f25a78"/>
Nov 16 18:08:04 user nova-compute[75342]:       <nova:ports>
Nov 16 18:08:04 user nova-compute[75342]:         <nova:port uuid="70d27952-7221-44f5-b6fb-24d3416b1b2e">
Nov 16 18:08:04 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 18:08:04 user nova-compute[75342]:         </nova:port>
Nov 16 18:08:04 user nova-compute[75342]:       </nova:ports>
Nov 16 18:08:04 user nova-compute[75342]:     </nova:instance>
Nov 16 18:08:04 user nova-compute[75342]:   </metadata>
Nov 16 18:08:04 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:08:04 user nova-compute[75342]:     <system>
Nov 16 18:08:04 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:08:04 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:08:04 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:08:04 user nova-compute[75342]:       <entry name="serial">fb00d09d-d7c3-43f8-a118-26868011460b</entry>
Nov 16 18:08:04 user nova-compute[75342]:       <entry name="uuid">fb00d09d-d7c3-43f8-a118-26868011460b</entry>
Nov 16 18:08:04 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:08:04 user nova-compute[75342]:     </system>
Nov 16 18:08:04 user nova-compute[75342]:   </sysinfo>
Nov 16 18:08:04 user nova-compute[75342]:   <os>
Nov 16 18:08:04 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:08:04 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:08:04 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:08:04 user nova-compute[75342]:   </os>
Nov 16 18:08:04 user nova-compute[75342]:   <features>
Nov 16 18:08:04 user nova-compute[75342]:     <acpi/>
Nov 16 18:08:04 user nova-compute[75342]:     <apic/>
Nov 16 18:08:04 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:08:04 user nova-compute[75342]:   </features>
Nov 16 18:08:04 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:08:04 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:08:04 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:08:04 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:08:04 user nova-compute[75342]:   </clock>
Nov 16 18:08:04 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:08:04 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:08:04 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:08:04 user nova-compute[75342]:   </cpu>
Nov 16 18:08:04 user nova-compute[75342]:   <devices>
Nov 16 18:08:04 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:08:04 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:08:04 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk"/>
Nov 16 18:08:04 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:08:04 user nova-compute[75342]:     </disk>
Nov 16 18:08:04 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:08:04 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:08:04 user nova-compute[75342]:       <source dev="/dev/sdg"/>
Nov 16 18:08:04 user nova-compute[75342]:       <target dev="vdc" bus="virtio"/>
Nov 16 18:08:04 user nova-compute[75342]:       <serial>e1508f04-5d7c-4fd6-bc91-c1c1884596e0</serial>
Nov 16 18:08:04 user nova-compute[75342]:     </disk>
Nov 16 18:08:04 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:08:04 user nova-compute[75342]:       <mac address="fa:16:3e:c5:bd:3a"/>
Nov 16 18:08:04 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:08:04 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:08:04 user nova-compute[75342]:       <target dev="tap70d27952-72"/>
Nov 16 18:08:04 user nova-compute[75342]:     </interface>
Nov 16 18:08:04 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:08:04 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/console.log" append="off"/>
Nov 16 18:08:04 user nova-compute[75342]:     </serial>
Nov 16 18:08:04 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:08:04 user nova-compute[75342]:     <video>
Nov 16 18:08:04 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:08:04 user nova-compute[75342]:     </video>
Nov 16 18:08:04 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:08:04 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:08:04 user nova-compute[75342]:     </rng>
Nov 16 18:08:04 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:08:04 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:08:04 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:08:04 user nova-compute[75342]:     </memballoon>
Nov 16 18:08:04 user nova-compute[75342]:   </devices>
Nov 16 18:08:04 user nova-compute[75342]: </domain>
Nov 16 18:08:04 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539067305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539067305',id=19,image_ref='c442e114-8792-494f-b052-c81603f25a78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-279505456',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-4tz76pmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member',shelved_at='2023-11-16T18:06:04.458438',shelved_host='user',shelved_image_id='c442e114-8792-494f-b052-c81603f25a78'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=fb00d09d-d7c3-43f8-a118-26868011460b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_vif [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '866db88f-72db-5b73-8660-f59504245c58', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a7fbf4-fca9-4093-a54d-0e99425cc270]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70d27952-72, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70d27952-72, col_values=(('qos', UUID('f5001c3c-e7a6-47ef-8ef9-ec3facc6aacb')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70d27952-72, col_values=(('external_ids', {'iface-id': '70d27952-7221-44f5-b6fb-24d3416b1b2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:bd:3a', 'vm-uuid': 'fb00d09d-d7c3-43f8-a118-26868011460b'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:04 user nova-compute[75342]: INFO os_vif [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72')
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c8cc5b-4bb0-4d67-89d4-67b29e41add2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:04 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:04 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:08:04 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:08:04 user nova-compute[75342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)
Nov 16 18:08:04 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:04 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:04 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:04 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:08:04 user nova-compute[75342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 (non-flash)
Nov 16 18:08:04 user nova-compute[75342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)
Nov 16 18:08:04 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:04 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c8559990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439'): ({'sde'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Removing single pathed devices sde {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9387ea02-7e31-4c35-9c38-453af9c1556b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2a38a0-4d75-4331-a3bf-4d12a41d5507]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flushing IO for device /dev/sde {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] No VIF found with MAC fa:16:3e:c5:bd:3a, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acfd419-1143-4a8c-bd11-9d18daf7b77e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c392b6a3-6c0c-4bf4-a18c-359063236f64]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cb8da3-c889-402c-9155-fd883c067d30]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa462e0-c265-4cda-9a6e-9f8d556a63e0]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439, portal: 172.16.0.220,3260]
Nov 16 18:08:05 user nova-compute[75342]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439, portal: 172.16.0.220,3260] successful.
Nov 16 18:08:05 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92bbaa28-751e-4e8a-999f-4a6d3c390439 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[564a8d09-d522-4464-bef3-d32d56bacaa9]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== disconnect_volume: return (1001ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:08:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Deleting instance files /opt/stack/data/nova/instances/d7c1a9b7-9251-4d6e-ae82-5176535eb9eb_del
Nov 16 18:08:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Deletion of /opt/stack/data/nova/instances/d7c1a9b7-9251-4d6e-ae82-5176535eb9eb_del complete
Nov 16 18:08:05 user nova-compute[75342]: INFO nova.compute.manager [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Took 2.03 seconds to destroy the instance on the hypervisor.
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-5dd16d36-cd30-4fd3-ab8e-11c1b6b9d6a5 req-9fe1d8d4-f85d-461a-8c4e-931572dcef6d service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Received event network-vif-plugged-ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5dd16d36-cd30-4fd3-ab8e-11c1b6b9d6a5 req-9fe1d8d4-f85d-461a-8c4e-931572dcef6d service nova] Acquiring lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5dd16d36-cd30-4fd3-ab8e-11c1b6b9d6a5 req-9fe1d8d4-f85d-461a-8c4e-931572dcef6d service nova] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5dd16d36-cd30-4fd3-ab8e-11c1b6b9d6a5 req-9fe1d8d4-f85d-461a-8c4e-931572dcef6d service nova] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-5dd16d36-cd30-4fd3-ab8e-11c1b6b9d6a5 req-9fe1d8d4-f85d-461a-8c4e-931572dcef6d service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] No waiting events found dispatching network-vif-plugged-ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:05 user nova-compute[75342]: WARNING nova.compute.manager [req-5dd16d36-cd30-4fd3-ab8e-11c1b6b9d6a5 req-9fe1d8d4-f85d-461a-8c4e-931572dcef6d service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Received unexpected event network-vif-plugged-ef11f485-5e98-470a-b000-44ce8fb72863 for instance with vm_state active and task_state deleting.
Nov 16 18:08:05 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:08:05 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Took 0.47 seconds to deallocate network for instance.
Nov 16 18:08:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-c7d25a67-5007-4b6a-8cf2-09578d6763d7 req-3533f366-7d27-469d-b104-139a5462138e service nova] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Received event network-vif-deleted-ef11f485-5e98-470a-b000-44ce8fb72863 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:06 user nova-compute[75342]: INFO nova.compute.manager [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Took 0.76 seconds to detach 1 volumes for instance.
Nov 16 18:08:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d7c1a9b7-9251-4d6e-ae82-5176535eb9eb] Deleting volume: 92bbaa28-751e-4e8a-999f-4a6d3c390439 {{(pid=75342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 18:08:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:07 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Deleted allocations for instance d7c1a9b7-9251-4d6e-ae82-5176535eb9eb
Nov 16 18:08:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a661d5db-2beb-48a8-b752-75b020db0216 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d7c1a9b7-9251-4d6e-ae82-5176535eb9eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.016s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] No waiting events found dispatching network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:07 user nova-compute[75342]: WARNING nova.compute.manager [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received unexpected event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 18:08:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] No waiting events found dispatching network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:07 user nova-compute[75342]: WARNING nova.compute.manager [req-14071f95-8cca-4c16-8229-176ae5c9135d req-99771ab1-ddbc-4e3c-bae6-9478ffb2b76e service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received unexpected event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 18:08:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:08:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:08:08 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Instance spawned successfully.
Nov 16 18:08:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "9b8d894f-9e43-4745-8a22-dc368a472320" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "9b8d894f-9e43-4745-8a22-dc368a472320" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:08 user nova-compute[75342]: INFO nova.compute.manager [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Terminating instance
Nov 16 18:08:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:08:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-59d64c94-288d-4ea2-a97d-7835c6ab9cf3 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.193s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:09 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Instance destroyed successfully.
Nov 16 18:08:09 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lazy-loading 'resources' on Instance uuid 9b8d894f-9e43-4745-8a22-dc368a472320 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-557315286',display_name='tempest-VolumesActionsTest-instance-557315286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-557315286',id=24,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab9d3323184440bfa3a59fe001304b3b',ramdisk_id='',reservation_id='r-oa09sjx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1486004135',owner_user_name='tempest-VolumesActionsTest-1486004135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:06:25Z,user_data=None,user_id='fd02be1850ee43f8943d236ed1093864',uuid=9b8d894f-9e43-4745-8a22-dc368a472320,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "address": "fa:16:3e:db:80:1f", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482aa27-46", "ovs_interfaceid": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converting VIF {"id": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "address": "fa:16:3e:db:80:1f", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482aa27-46", "ovs_interfaceid": "7482aa27-469e-4e49-b956-ca5bf5dcd7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=7482aa27-469e-4e49-b956-ca5bf5dcd7bf,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482aa27-46') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG os_vif [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=7482aa27-469e-4e49-b956-ca5bf5dcd7bf,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482aa27-46') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7482aa27-46, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9892999-0222-4059-84fc-3b806643f8be) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:08:09 user nova-compute[75342]: INFO os_vif [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=7482aa27-469e-4e49-b956-ca5bf5dcd7bf,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482aa27-46')
Nov 16 18:08:09 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Deleting instance files /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320_del
Nov 16 18:08:09 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Deletion of /opt/stack/data/nova/instances/9b8d894f-9e43-4745-8a22-dc368a472320_del complete
Nov 16 18:08:09 user nova-compute[75342]: INFO nova.compute.manager [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 16 18:08:09 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Received event network-vif-unplugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] Acquiring lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] Lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] Lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] No waiting events found dispatching network-vif-unplugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Received event network-vif-unplugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Received event network-vif-plugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] Acquiring lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] Lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] Lock "9b8d894f-9e43-4745-8a22-dc368a472320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] No waiting events found dispatching network-vif-plugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:09 user nova-compute[75342]: WARNING nova.compute.manager [req-2120d62a-a620-41b2-81e0-3113938b4626 req-c3a0492d-a532-455d-abc9-7f807cbad432 service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Received unexpected event network-vif-plugged-7482aa27-469e-4e49-b956-ca5bf5dcd7bf for instance with vm_state active and task_state deleting.
Nov 16 18:08:10 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:08:10 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Took 0.65 seconds to deallocate network for instance.
Nov 16 18:08:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:10 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:08:10 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:08:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:10 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Deleted allocations for instance 9b8d894f-9e43-4745-8a22-dc368a472320
Nov 16 18:08:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b2714dc4-784c-49a5-bd4f-d696f11a8ef0 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "9b8d894f-9e43-4745-8a22-dc368a472320" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-a047b1a4-6b8f-405a-b3ca-bbeb5d59e22d req-01991be8-0597-4d1c-83c3-7a1b55b43d0d service nova] [instance: 9b8d894f-9e43-4745-8a22-dc368a472320] Received event network-vif-deleted-7482aa27-469e-4e49-b956-ca5bf5dcd7bf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:13 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 is timed out.
Nov 16 18:08:13 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Successfully detached device vdb from instance 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 from the live domain config.
Nov 16 18:08:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rInZBWei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:08:13 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[51aaf90e-3f66-4a3b-9408-d1c0938e5351]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:08:13 user nova-compute[75342]: No targets found.
Nov 16 18:08:13 user nova-compute[75342]: iSNS:
Nov 16 18:08:13 user nova-compute[75342]: No targets found.
Nov 16 18:08:13 user nova-compute[75342]: STATIC:
Nov 16 18:08:13 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be
Nov 16 18:08:13 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:13 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:13 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd
Nov 16 18:08:13 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:13 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:13 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:08:13 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:13 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:13 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4
Nov 16 18:08:13 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:13 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:13 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0
Nov 16 18:08:13 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:13 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:13 user nova-compute[75342]: FIRMWARE:
Nov 16 18:08:13 user nova-compute[75342]: No targets found.
Nov 16 18:08:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:08:13 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:08:13 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b17e1e-29f7-49bf-9097-56d14e5e3063]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ca56b8-5ecf-41da-a32d-d18708411d06]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:13 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:13 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:08:13 user nova-compute[75342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)
Nov 16 18:08:13 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:13 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:13 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:08:13 user nova-compute[75342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 (non-flash)
Nov 16 18:08:13 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4518dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4'): ({'sdf'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Removing single pathed devices sdf {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[418b8c7e-3294-4141-b66d-880898360a41]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[77411f04-ab79-469f-9378-fe73f69ea27a]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Flushing IO for device /dev/sdf {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1925399-9f7e-450c-8343-573b2e534573]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aa81a0-eca6-4fef-a312-ad500ea69548]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] SCSI volumes sdf have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8722fbab-bc6c-4210-a394-1b6e1db740ea]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d434f7-a578-4501-b0e6-1d159bf9f3e0]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4, portal: 172.16.0.220,3260]
Nov 16 18:08:13 user nova-compute[75342]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4, portal: 172.16.0.220,3260] successful.
Nov 16 18:08:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9201f-91db-4746-971d-22b1dca0f8a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7c7f31-7b5d-4c03-915e-dbea3401bb58]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] <== disconnect_volume: return (363ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:08:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:08:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:16 user nova-compute[75342]: DEBUG nova.objects.instance [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lazy-loading 'flavor' on Instance uuid 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-78bc1fc9-02dc-41ed-afe6-1a79778b5c9a tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.894s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "120e116f-a0e5-406c-9883-6f173da89100" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "120e116f-a0e5-406c-9883-6f173da89100" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:08:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:18 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:08:18 user nova-compute[75342]: INFO nova.compute.claims [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Claim successful on node user
Nov 16 18:08:19 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:08:19 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:08:19 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG nova.policy [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13beba5fa97a448fa863135a45e47cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542bb854a1647618ba3995c4342109a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:08:19 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Creating image(s)
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "/opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "/opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "/opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.193s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk 1073741824" returned: 0 in 0.054s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:19 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Successfully created port: 7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Checking if we can resize image /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Cannot resize image /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Ensure instance console log exists: /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Successfully updated port: 7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "refresh_cache-120e116f-a0e5-406c-9883-6f173da89100" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquired lock "refresh_cache-120e116f-a0e5-406c-9883-6f173da89100" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-5e586cef-5ba9-42c2-9348-99229f649f21 req-2345ddcf-6324-47f1-807a-cf54ef287a13 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Received event network-changed-7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-5e586cef-5ba9-42c2-9348-99229f649f21 req-2345ddcf-6324-47f1-807a-cf54ef287a13 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Refreshing instance network info cache due to event network-changed-7e2bea56-517c-4a7c-aec3-4b9f951e2605. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5e586cef-5ba9-42c2-9348-99229f649f21 req-2345ddcf-6324-47f1-807a-cf54ef287a13 service nova] Acquiring lock "refresh_cache-120e116f-a0e5-406c-9883-6f173da89100" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Updating instance_info_cache with network_info: [{"id": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "address": "fa:16:3e:0b:b9:34", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2bea56-51", "ovs_interfaceid": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Releasing lock "refresh_cache-120e116f-a0e5-406c-9883-6f173da89100" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Instance network_info: |[{"id": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "address": "fa:16:3e:0b:b9:34", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2bea56-51", "ovs_interfaceid": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5e586cef-5ba9-42c2-9348-99229f649f21 req-2345ddcf-6324-47f1-807a-cf54ef287a13 service nova] Acquired lock "refresh_cache-120e116f-a0e5-406c-9883-6f173da89100" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.network.neutron [req-5e586cef-5ba9-42c2-9348-99229f649f21 req-2345ddcf-6324-47f1-807a-cf54ef287a13 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Refreshing network info cache for port 7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Start _get_guest_xml network_info=[{"id": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "address": "fa:16:3e:0b:b9:34", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2bea56-51", "ovs_interfaceid": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:08:20 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:08:20 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-717253090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-717253090',id=26,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-8jtyrc1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:08:19Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=120e116f-a0e5-406c-9883-6f173da89100,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "address": "fa:16:3e:0b:b9:34", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2bea56-51", "ovs_interfaceid": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "address": "fa:16:3e:0b:b9:34", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2bea56-51", "ovs_interfaceid": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:34,bridge_name='br-int',has_traffic_filtering=True,id=7e2bea56-517c-4a7c-aec3-4b9f951e2605,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2bea56-51') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.objects.instance [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'pci_devices' on Instance uuid 120e116f-a0e5-406c-9883-6f173da89100 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:08:20 user nova-compute[75342]:   <uuid>120e116f-a0e5-406c-9883-6f173da89100</uuid>
Nov 16 18:08:20 user nova-compute[75342]:   <name>instance-0000001a</name>
Nov 16 18:08:20 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:08:20 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:08:20 user nova-compute[75342]:   <metadata>
Nov 16 18:08:20 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:08:20 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:08:20 user nova-compute[75342]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-717253090</nova:name>
Nov 16 18:08:20 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:08:20</nova:creationTime>
Nov 16 18:08:20 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:08:20 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:08:20 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:08:20 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:08:20 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:08:20 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:08:20 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:08:20 user nova-compute[75342]:       <nova:owner>
Nov 16 18:08:20 user nova-compute[75342]:         <nova:user uuid="13beba5fa97a448fa863135a45e47cb9">tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member</nova:user>
Nov 16 18:08:20 user nova-compute[75342]:         <nova:project uuid="4542bb854a1647618ba3995c4342109a">tempest-ServerBootFromVolumeStableRescueTest-764398626</nova:project>
Nov 16 18:08:20 user nova-compute[75342]:       </nova:owner>
Nov 16 18:08:20 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:08:20 user nova-compute[75342]:       <nova:ports>
Nov 16 18:08:20 user nova-compute[75342]:         <nova:port uuid="7e2bea56-517c-4a7c-aec3-4b9f951e2605">
Nov 16 18:08:20 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 18:08:20 user nova-compute[75342]:         </nova:port>
Nov 16 18:08:20 user nova-compute[75342]:       </nova:ports>
Nov 16 18:08:20 user nova-compute[75342]:     </nova:instance>
Nov 16 18:08:20 user nova-compute[75342]:   </metadata>
Nov 16 18:08:20 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:08:20 user nova-compute[75342]:     <system>
Nov 16 18:08:20 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:08:20 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:08:20 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:08:20 user nova-compute[75342]:       <entry name="serial">120e116f-a0e5-406c-9883-6f173da89100</entry>
Nov 16 18:08:20 user nova-compute[75342]:       <entry name="uuid">120e116f-a0e5-406c-9883-6f173da89100</entry>
Nov 16 18:08:20 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:08:20 user nova-compute[75342]:     </system>
Nov 16 18:08:20 user nova-compute[75342]:   </sysinfo>
Nov 16 18:08:20 user nova-compute[75342]:   <os>
Nov 16 18:08:20 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:08:20 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:08:20 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:08:20 user nova-compute[75342]:   </os>
Nov 16 18:08:20 user nova-compute[75342]:   <features>
Nov 16 18:08:20 user nova-compute[75342]:     <acpi/>
Nov 16 18:08:20 user nova-compute[75342]:     <apic/>
Nov 16 18:08:20 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:08:20 user nova-compute[75342]:   </features>
Nov 16 18:08:20 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:08:20 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:08:20 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:08:20 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:08:20 user nova-compute[75342]:   </clock>
Nov 16 18:08:20 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:08:20 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:08:20 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:08:20 user nova-compute[75342]:   </cpu>
Nov 16 18:08:20 user nova-compute[75342]:   <devices>
Nov 16 18:08:20 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:08:20 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:08:20 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk"/>
Nov 16 18:08:20 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:08:20 user nova-compute[75342]:     </disk>
Nov 16 18:08:20 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:08:20 user nova-compute[75342]:       <mac address="fa:16:3e:0b:b9:34"/>
Nov 16 18:08:20 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:08:20 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:08:20 user nova-compute[75342]:       <target dev="tap7e2bea56-51"/>
Nov 16 18:08:20 user nova-compute[75342]:     </interface>
Nov 16 18:08:20 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:08:20 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/console.log" append="off"/>
Nov 16 18:08:20 user nova-compute[75342]:     </serial>
Nov 16 18:08:20 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:08:20 user nova-compute[75342]:     <video>
Nov 16 18:08:20 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:08:20 user nova-compute[75342]:     </video>
Nov 16 18:08:20 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:08:20 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:08:20 user nova-compute[75342]:     </rng>
Nov 16 18:08:20 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:08:20 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:08:20 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:08:20 user nova-compute[75342]:     </memballoon>
Nov 16 18:08:20 user nova-compute[75342]:   </devices>
Nov 16 18:08:20 user nova-compute[75342]: </domain>
Nov 16 18:08:20 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-717253090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-717253090',id=26,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-8jtyrc1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:08:19Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=120e116f-a0e5-406c-9883-6f173da89100,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "address": "fa:16:3e:0b:b9:34", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2bea56-51", "ovs_interfaceid": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "address": "fa:16:3e:0b:b9:34", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2bea56-51", "ovs_interfaceid": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:34,bridge_name='br-int',has_traffic_filtering=True,id=7e2bea56-517c-4a7c-aec3-4b9f951e2605,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2bea56-51') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG os_vif [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:34,bridge_name='br-int',has_traffic_filtering=True,id=7e2bea56-517c-4a7c-aec3-4b9f951e2605,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2bea56-51') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2219c985-d2fc-5666-9c44-2d49aeff27f2', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e2bea56-51, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e2bea56-51, col_values=(('qos', UUID('36141431-e559-4471-96bb-3f64ca59df57')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e2bea56-51, col_values=(('external_ids', {'iface-id': '7e2bea56-517c-4a7c-aec3-4b9f951e2605', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:b9:34', 'vm-uuid': '120e116f-a0e5-406c-9883-6f173da89100'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:08:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:21 user nova-compute[75342]: INFO os_vif [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:34,bridge_name='br-int',has_traffic_filtering=True,id=7e2bea56-517c-4a7c-aec3-4b9f951e2605,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2bea56-51')
Nov 16 18:08:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:08:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No VIF found with MAC fa:16:3e:0b:b9:34, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:08:21 user nova-compute[75342]: INFO nova.compute.manager [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Detaching volume e04bcbb1-af36-4770-8307-c95ec0dc26be
Nov 16 18:08:21 user nova-compute[75342]: INFO nova.virt.block_device [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Attempting to driver detach volume e04bcbb1-af36-4770-8307-c95ec0dc26be from mountpoint /dev/vdb
Nov 16 18:08:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Attempting to detach device vdb from instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:08:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:08:21 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:08:21 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:08:21 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:08:21 user nova-compute[75342]:   <serial>e04bcbb1-af36-4770-8307-c95ec0dc26be</serial>
Nov 16 18:08:21 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 18:08:21 user nova-compute[75342]: </disk>
Nov 16 18:08:21 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:08:21 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully detached device vdb from instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 from the persistent domain config.
Nov 16 18:08:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:08:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:08:21 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:08:21 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:08:21 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:08:21 user nova-compute[75342]:   <serial>e04bcbb1-af36-4770-8307-c95ec0dc26be</serial>
Nov 16 18:08:21 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 18:08:21 user nova-compute[75342]: </disk>
Nov 16 18:08:21 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:08:21 user nova-compute[75342]: DEBUG nova.network.neutron [req-5e586cef-5ba9-42c2-9348-99229f649f21 req-2345ddcf-6324-47f1-807a-cf54ef287a13 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Updated VIF entry in instance network info cache for port 7e2bea56-517c-4a7c-aec3-4b9f951e2605. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:08:21 user nova-compute[75342]: DEBUG nova.network.neutron [req-5e586cef-5ba9-42c2-9348-99229f649f21 req-2345ddcf-6324-47f1-807a-cf54ef287a13 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Updating instance_info_cache with network_info: [{"id": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "address": "fa:16:3e:0b:b9:34", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2bea56-51", "ovs_interfaceid": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:08:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5e586cef-5ba9-42c2-9348-99229f649f21 req-2345ddcf-6324-47f1-807a-cf54ef287a13 service nova] Releasing lock "refresh_cache-120e116f-a0e5-406c-9883-6f173da89100" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:08:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:08:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-f879a22f-0be2-43f1-8b38-6dea7ffb4448 req-9acf94a0-6cb8-4a21-8d4b-9bd64f5b0cb1 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Received event network-vif-plugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f879a22f-0be2-43f1-8b38-6dea7ffb4448 req-9acf94a0-6cb8-4a21-8d4b-9bd64f5b0cb1 service nova] Acquiring lock "120e116f-a0e5-406c-9883-6f173da89100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f879a22f-0be2-43f1-8b38-6dea7ffb4448 req-9acf94a0-6cb8-4a21-8d4b-9bd64f5b0cb1 service nova] Lock "120e116f-a0e5-406c-9883-6f173da89100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f879a22f-0be2-43f1-8b38-6dea7ffb4448 req-9acf94a0-6cb8-4a21-8d4b-9bd64f5b0cb1 service nova] Lock "120e116f-a0e5-406c-9883-6f173da89100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-f879a22f-0be2-43f1-8b38-6dea7ffb4448 req-9acf94a0-6cb8-4a21-8d4b-9bd64f5b0cb1 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] No waiting events found dispatching network-vif-plugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:22 user nova-compute[75342]: WARNING nova.compute.manager [req-f879a22f-0be2-43f1-8b38-6dea7ffb4448 req-9acf94a0-6cb8-4a21-8d4b-9bd64f5b0cb1 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Received unexpected event network-vif-plugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 for instance with vm_state building and task_state spawning.
Nov 16 18:08:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:08:24 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Instance spawned successfully.
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:08:24 user nova-compute[75342]: INFO nova.compute.manager [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-24d2aaf8-f933-4169-95a2-611bb514fed1 req-f815f169-9299-464e-9a07-862459f775d5 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Received event network-vif-plugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-24d2aaf8-f933-4169-95a2-611bb514fed1 req-f815f169-9299-464e-9a07-862459f775d5 service nova] Acquiring lock "120e116f-a0e5-406c-9883-6f173da89100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-24d2aaf8-f933-4169-95a2-611bb514fed1 req-f815f169-9299-464e-9a07-862459f775d5 service nova] Lock "120e116f-a0e5-406c-9883-6f173da89100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-24d2aaf8-f933-4169-95a2-611bb514fed1 req-f815f169-9299-464e-9a07-862459f775d5 service nova] Lock "120e116f-a0e5-406c-9883-6f173da89100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-24d2aaf8-f933-4169-95a2-611bb514fed1 req-f815f169-9299-464e-9a07-862459f775d5 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] No waiting events found dispatching network-vif-plugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:24 user nova-compute[75342]: WARNING nova.compute.manager [req-24d2aaf8-f933-4169-95a2-611bb514fed1 req-f815f169-9299-464e-9a07-862459f775d5 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Received unexpected event network-vif-plugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 for instance with vm_state building and task_state spawning.
Nov 16 18:08:25 user nova-compute[75342]: INFO nova.compute.manager [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Took 6.42 seconds to build instance.
Nov 16 18:08:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc32a691-493e-4c99-b63c-c970d30e6f6f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "120e116f-a0e5-406c-9883-6f173da89100" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.521s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:28 user nova-compute[75342]: INFO nova.compute.manager [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Terminating instance
Nov 16 18:08:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-49ae83bd-6c7e-4fb3-90a4-38dab0a17b05 req-7151aef3-4454-4c0c-84ee-cad6cbfc2df3 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-unplugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-49ae83bd-6c7e-4fb3-90a4-38dab0a17b05 req-7151aef3-4454-4c0c-84ee-cad6cbfc2df3 service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-49ae83bd-6c7e-4fb3-90a4-38dab0a17b05 req-7151aef3-4454-4c0c-84ee-cad6cbfc2df3 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-49ae83bd-6c7e-4fb3-90a4-38dab0a17b05 req-7151aef3-4454-4c0c-84ee-cad6cbfc2df3 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-49ae83bd-6c7e-4fb3-90a4-38dab0a17b05 req-7151aef3-4454-4c0c-84ee-cad6cbfc2df3 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-unplugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-49ae83bd-6c7e-4fb3-90a4-38dab0a17b05 req-7151aef3-4454-4c0c-84ee-cad6cbfc2df3 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-unplugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:29 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Instance destroyed successfully.
Nov 16 18:08:29 user nova-compute[75342]: DEBUG nova.objects.instance [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lazy-loading 'resources' on Instance uuid 2992b5fc-86e6-425f-82e5-cf6358582872 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1606614034',display_name='tempest-ServerActionsTestOtherB-server-1606614034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1606614034',id=4,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1UyBGifbaRVIIusr59UKLEcXLfyd6epVSgRuItUg0lc3AijdYFqlIZoLMbi5dO5JpMBiHIhBKHMDap+u4RdhUKBD/7ZLtWgtZhiB+iJEQy+7uabGfTLiM4pLG8U3m+Tg==',key_name='tempest-keypair-290385198',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:05:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f427ee24cf34d538c1b2ae19266b9f3',ramdisk_id='',reservation_id='r-v0hi3c4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-613458522',owner_user_name='tempest-ServerActionsTestOtherB-613458522-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:05:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67704d03b80e4d709863960014fbcd24',uuid=2992b5fc-86e6-425f-82e5-cf6358582872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converting VIF {"id": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "address": "fa:16:3e:f5:5a:de", "network": {"id": "30fa110a-6abf-4591-9f60-366aee3e8516", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1537222285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f427ee24cf34d538c1b2ae19266b9f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a1cbd5-36", "ovs_interfaceid": "b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_vif [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2a1cbd5-36, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=887c2a4d-9ad9-4c75-9b3c-de5dc158c636) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:29 user nova-compute[75342]: INFO os_vif [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5a:de,bridge_name='br-int',has_traffic_filtering=True,id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf,network=Network(30fa110a-6abf-4591-9f60-366aee3e8516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a1cbd5-36')
Nov 16 18:08:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrZWgwTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:08:29 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e2a2a7-2dcf-4939-b987-b8f8da4a2f4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:08:29 user nova-compute[75342]: No targets found.
Nov 16 18:08:29 user nova-compute[75342]: iSNS:
Nov 16 18:08:29 user nova-compute[75342]: No targets found.
Nov 16 18:08:29 user nova-compute[75342]: STATIC:
Nov 16 18:08:29 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be
Nov 16 18:08:29 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:29 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:29 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd
Nov 16 18:08:29 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:29 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:29 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b
Nov 16 18:08:29 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:29 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:29 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:08:29 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:29 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:29 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0
Nov 16 18:08:29 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:29 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:29 user nova-compute[75342]: FIRMWARE:
Nov 16 18:08:29 user nova-compute[75342]: No targets found.
Nov 16 18:08:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:08:29 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:08:29 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d722e55-829a-4989-ab13-9ef1f8ff6948]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a429f65e-8e45-429f-a83e-e072a81e562f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:29 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:29 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:08:29 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:29 user nova-compute[75342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b (non-flash)
Nov 16 18:08:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:29 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:29 user nova-compute[75342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd (non-flash)
Nov 16 18:08:29 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:29 user nova-compute[75342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b (non-flash)
Nov 16 18:08:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4696cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd'): ({'sdc'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Removing single pathed devices sdc {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[377b0bb4-5851-4896-86b0-aad949e7e78b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db78732-a172-4ce1-8968-25d8885e3bab]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Flushing IO for device /dev/sdc {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb873966-53a1-4b4a-99c9-e65efaa03225]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4470c2e6-17f5-49d6-979f-002c5aea81a6]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c39ca5-83c5-4f5e-9bca-b71d32588b98]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f5e2a5-54ef-4771-9587-41592d96740f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260]
Nov 16 18:08:29 user nova-compute[75342]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd, portal: 172.16.0.220,3260] successful.
Nov 16 18:08:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bab4e-3e74-453a-8ab6-e9f7da5ea1dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c9c818-f350-45ae-a2a1-e85682690b6c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] <== disconnect_volume: return (310ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:08:29 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Deleting instance files /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872_del
Nov 16 18:08:29 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Deletion of /opt/stack/data/nova/instances/2992b5fc-86e6-425f-82e5-cf6358582872_del complete
Nov 16 18:08:29 user nova-compute[75342]: INFO nova.compute.manager [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 16 18:08:29 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:08:29 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:08:30 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:08:30 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Took 0.97 seconds to deallocate network for instance.
Nov 16 18:08:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-4a80dd3f-8b65-46d3-9c7b-154c54c413f2 req-5e676a4e-0a00-4644-97bd-c976a6ace7eb service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-deleted-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:30 user nova-compute[75342]: INFO nova.compute.manager [req-4a80dd3f-8b65-46d3-9c7b-154c54c413f2 req-5e676a4e-0a00-4644-97bd-c976a6ace7eb service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Neutron deleted interface b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf; detaching it from the instance and deleting it from the info cache
Nov 16 18:08:30 user nova-compute[75342]: DEBUG nova.network.neutron [req-4a80dd3f-8b65-46d3-9c7b-154c54c413f2 req-5e676a4e-0a00-4644-97bd-c976a6ace7eb service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:08:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-91681aee-af62-476a-8260-676586a20727 req-e054afd0-08e0-45b2-a18c-172199550950 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-91681aee-af62-476a-8260-676586a20727 req-e054afd0-08e0-45b2-a18c-172199550950 service nova] Acquiring lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-91681aee-af62-476a-8260-676586a20727 req-e054afd0-08e0-45b2-a18c-172199550950 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-91681aee-af62-476a-8260-676586a20727 req-e054afd0-08e0-45b2-a18c-172199550950 service nova] Lock "2992b5fc-86e6-425f-82e5-cf6358582872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-91681aee-af62-476a-8260-676586a20727 req-e054afd0-08e0-45b2-a18c-172199550950 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] No waiting events found dispatching network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:30 user nova-compute[75342]: WARNING nova.compute.manager [req-91681aee-af62-476a-8260-676586a20727 req-e054afd0-08e0-45b2-a18c-172199550950 service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Received unexpected event network-vif-plugged-b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf for instance with vm_state active and task_state deleting.
Nov 16 18:08:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-4a80dd3f-8b65-46d3-9c7b-154c54c413f2 req-5e676a4e-0a00-4644-97bd-c976a6ace7eb service nova] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Detach interface failed, port_id=b2a1cbd5-363a-4b61-9d4c-7eb4708fb2cf, reason: Instance 2992b5fc-86e6-425f-82e5-cf6358582872 could not be found. {{(pid=75342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 18:08:31 user nova-compute[75342]: INFO nova.compute.manager [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] [instance: 2992b5fc-86e6-425f-82e5-cf6358582872] Took 0.95 seconds to detach 1 volumes for instance.
Nov 16 18:08:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:32 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:08:32 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:08:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:32 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Deleted allocations for instance 2992b5fc-86e6-425f-82e5-cf6358582872
Nov 16 18:08:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-977370cb-6de3-423b-b3fc-8f9698915588 tempest-ServerActionsTestOtherB-613458522 tempest-ServerActionsTestOtherB-613458522-project-member] Lock "2992b5fc-86e6-425f-82e5-cf6358582872" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.886s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:08:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:08:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:08:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:08:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:08:37 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:08:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-d13e7bcb-cc9d-4286-b257-beb885d047f4 req-a4b5ee1e-49b8-41be-97b4-0a7b40a6ce5a service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-changed-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-d13e7bcb-cc9d-4286-b257-beb885d047f4 req-a4b5ee1e-49b8-41be-97b4-0a7b40a6ce5a service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Refreshing instance network info cache due to event network-changed-326f6a9c-1559-4846-b2df-cb6b8ac9eed9. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:08:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d13e7bcb-cc9d-4286-b257-beb885d047f4 req-a4b5ee1e-49b8-41be-97b4-0a7b40a6ce5a service nova] Acquiring lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:08:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d13e7bcb-cc9d-4286-b257-beb885d047f4 req-a4b5ee1e-49b8-41be-97b4-0a7b40a6ce5a service nova] Acquired lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:08:39 user nova-compute[75342]: DEBUG nova.network.neutron [req-d13e7bcb-cc9d-4286-b257-beb885d047f4 req-a4b5ee1e-49b8-41be-97b4-0a7b40a6ce5a service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Refreshing network info cache for port 326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:08:39 user nova-compute[75342]: DEBUG nova.network.neutron [req-d13e7bcb-cc9d-4286-b257-beb885d047f4 req-a4b5ee1e-49b8-41be-97b4-0a7b40a6ce5a service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Updated VIF entry in instance network info cache for port 326f6a9c-1559-4846-b2df-cb6b8ac9eed9. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:08:39 user nova-compute[75342]: DEBUG nova.network.neutron [req-d13e7bcb-cc9d-4286-b257-beb885d047f4 req-a4b5ee1e-49b8-41be-97b4-0a7b40a6ce5a service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Updating instance_info_cache with network_info: [{"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:08:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d13e7bcb-cc9d-4286-b257-beb885d047f4 req-a4b5ee1e-49b8-41be-97b4-0a7b40a6ce5a service nova] Releasing lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:08:40 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:08:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:40 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:08:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 is timed out.
Nov 16 18:08:41 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully detached device vdb from instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 from the live domain config.
Nov 16 18:08:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibfAcHTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:08:41 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d35cc5-d691-4536-945c-41bfc1b67467]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e069d2f-17f6-43fe-84cc-6b71b3202cdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:08:41 user nova-compute[75342]: No targets found.
Nov 16 18:08:41 user nova-compute[75342]: iSNS:
Nov 16 18:08:41 user nova-compute[75342]: No targets found.
Nov 16 18:08:41 user nova-compute[75342]: STATIC:
Nov 16 18:08:41 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:7e069d2f-17f6-43fe-84cc-6b71b3202cdf
Nov 16 18:08:41 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:41 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:41 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be
Nov 16 18:08:41 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:41 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:41 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b
Nov 16 18:08:41 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:41 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:41 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:08:41 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:41 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:41 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0
Nov 16 18:08:41 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:08:41 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:08:41 user nova-compute[75342]: FIRMWARE:
Nov 16 18:08:41 user nova-compute[75342]: No targets found.
Nov 16 18:08:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:08:41 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:08:41 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c42930-a411-4f42-a833-50534ffadeb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e069d2f-17f6-43fe-84cc-6b71b3202cdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f52bac3-35b3-4140-86c9-a717c7dd43db]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e069d2f-17f6-43fe-84cc-6b71b3202cdf (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:41 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:41 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:41 user nova-compute[75342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b (non-flash)
Nov 16 18:08:41 user nova-compute[75342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e069d2f-17f6-43fe-84cc-6b71b3202cdf (non-flash)
Nov 16 18:08:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:41 user nova-compute[75342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be (non-flash)
Nov 16 18:08:41 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:41 user nova-compute[75342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94ad5bfa-55f8-4fc2-aa96-f4020bfa603b (non-flash)
Nov 16 18:08:41 user nova-compute[75342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e069d2f-17f6-43fe-84cc-6b71b3202cdf (non-flash)
Nov 16 18:08:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c86f5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92926d0-942e-4261-accb-4759e95cb090]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ca89c4-95e6-471a-93ff-2badda8481d7]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b07ee4-11ad-4431-8867-bd22c44b78f3]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1651d6-f068-417b-b8b0-b976c4bc30ef]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc82799-657d-4052-9042-fa041a521ef7]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[033bfc05-656e-496b-86c9-87c7ff1fc5d0]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260]
Nov 16 18:08:42 user nova-compute[75342]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be, portal: 172.16.0.220,3260] successful.
Nov 16 18:08:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e04bcbb1-af36-4770-8307-c95ec0dc26be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[912d5fba-09f9-4a69-93aa-ea687836ffd4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== disconnect_volume: return (384ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG nova.objects.instance [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:42 user nova-compute[75342]: INFO nova.compute.manager [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Attaching volume ed80d9c2-3208-4679-8fd7-b350b2ab807e to /dev/vdb
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG os_brick.utils [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[27598d19-3fd2-4b2c-b5bb-c3878b4db44b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f623b7-3bc3-4a58-bc54-23377435c8a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d38cd4e-a9e2-40a5-8631-a27b626f80db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a4e69c-c283-4396-98a6-01665f4d1bb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:08:42 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[be459675-0b6d-416b-82cd-2dcc85c265a2]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG os_brick.utils [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Updating existing volume attachment record: 6f072cd4-890f-40fd-90bf-e2bd9bfec4be {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:42 user nova-compute[75342]: DEBUG nova.objects.instance [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'flavor' on Instance uuid 28eaadcb-3f00-4868-8115-b5d4ba9454f3 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-247b04db-84c3-46c8-9d90-b5de683e0984 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.966s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:45 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:08:45 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7378MB free_disk=25.21026611328125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c6408c85-ed86-4b11-afa6-14f93b92492c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance fb00d09d-d7c3-43f8-a118-26868011460b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 120e116f-a0e5-406c-9883-6f173da89100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:08:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:46 user nova-compute[75342]: INFO nova.compute.manager [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Terminating instance
Nov 16 18:08:46 user nova-compute[75342]: DEBUG nova.compute.manager [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-d30dd7fb-0db6-4308-8202-36e3d9c92778 req-e98f23bb-6f21-449a-b23c-42313f372cc3 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Received event network-vif-unplugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d30dd7fb-0db6-4308-8202-36e3d9c92778 req-e98f23bb-6f21-449a-b23c-42313f372cc3 service nova] Acquiring lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d30dd7fb-0db6-4308-8202-36e3d9c92778 req-e98f23bb-6f21-449a-b23c-42313f372cc3 service nova] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d30dd7fb-0db6-4308-8202-36e3d9c92778 req-e98f23bb-6f21-449a-b23c-42313f372cc3 service nova] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-d30dd7fb-0db6-4308-8202-36e3d9c92778 req-e98f23bb-6f21-449a-b23c-42313f372cc3 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] No waiting events found dispatching network-vif-unplugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-d30dd7fb-0db6-4308-8202-36e3d9c92778 req-e98f23bb-6f21-449a-b23c-42313f372cc3 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Received event network-vif-unplugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:08:47 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Instance destroyed successfully.
Nov 16 18:08:47 user nova-compute[75342]: DEBUG nova.objects.instance [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lazy-loading 'resources' on Instance uuid 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-697398401',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-697398401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6973984',id=22,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcwx0Orjt6Ca/Yih36YeYLgaT1UomcNsrVSAhEP/MGM4Su8rNfSWoBkKLpkIFsLHmIXhU1pk0eSs1jdoPm+714n2rlaTIANmtnTlgUx+LV7qePuTEZcr+UgPFnw5xMmzw==',key_name='tempest-keypair-1136982146',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:05:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d165c413794047efaea43b92a124f937',ramdisk_id='',reservation_id='r-8a46eqj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1722200781',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:05:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31989b60047b497081580f6a7c0b7c91',uuid=218bd8cd-58a5-40b3-a989-5aea6a5c9c43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "address": "fa:16:3e:c5:f5:ba", "network": {"id": "84a047a1-f39f-4ca6-a9db-6cc532a1d632", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1681619625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d165c413794047efaea43b92a124f937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258320a2-30", "ovs_interfaceid": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Converting VIF {"id": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "address": "fa:16:3e:c5:f5:ba", "network": {"id": "84a047a1-f39f-4ca6-a9db-6cc532a1d632", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1681619625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d165c413794047efaea43b92a124f937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258320a2-30", "ovs_interfaceid": "258320a2-30f7-4c04-bb9f-49a4caa90b3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f5:ba,bridge_name='br-int',has_traffic_filtering=True,id=258320a2-30f7-4c04-bb9f-49a4caa90b3f,network=Network(84a047a1-f39f-4ca6-a9db-6cc532a1d632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258320a2-30') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_vif [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f5:ba,bridge_name='br-int',has_traffic_filtering=True,id=258320a2-30f7-4c04-bb9f-49a4caa90b3f,network=Network(84a047a1-f39f-4ca6-a9db-6cc532a1d632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258320a2-30') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap258320a2-30, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15c6932c-2806-4b0c-ac85-473871823404) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:08:47 user nova-compute[75342]: INFO os_vif [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f5:ba,bridge_name='br-int',has_traffic_filtering=True,id=258320a2-30f7-4c04-bb9f-49a4caa90b3f,network=Network(84a047a1-f39f-4ca6-a9db-6cc532a1d632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258320a2-30')
Nov 16 18:08:47 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Deleting instance files /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43_del
Nov 16 18:08:47 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Deletion of /opt/stack/data/nova/instances/218bd8cd-58a5-40b3-a989-5aea6a5c9c43_del complete
Nov 16 18:08:47 user nova-compute[75342]: INFO nova.compute.manager [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Updating instance_info_cache with network_info: [{"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVMmveyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:08:47 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:08:47 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:08:47 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[76243763-4545-4fd5-9a08-eaac382a187c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:08:47 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4217f5d7-9f93-443e-8261-5d883662f15a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e] added
Nov 16 18:08:47 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[299a06cc-7114-4357-9302-7e653b992989]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c6f911-38eb-4c6d-8a84-db6bd5bc440b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IVMmveyF {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IVMmveyF" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[346779a0-a200-4235-98a1-69273cd3871b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IVMmveyF'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[09620fb5-a37e-4523-8592-d00bde2571c3]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c870a65d-e3c6-4665-91c2-122a814f524c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:47 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:47 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:47 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:47 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f3a7e7-c857-4ba6-9153-e1f1eebf6fce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260]
Nov 16 18:08:47 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260] successful.
Nov 16 18:08:47 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf425552-1edf-4c9d-8d37-5453b4c64f72]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7735ddb4-3681-4741-add4-ad1c71ececb7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:48 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:48 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:08:48 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:08:48 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:08:48 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:08:48 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[640f7b8a-f5b9-476a-8a44-18d1f6d99dc1]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVMmveyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:08:48 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Took 0.96 seconds to deallocate network for instance.
Nov 16 18:08:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-b632c708-50ca-4656-837a-b3a2deb71160 req-5ee7e5c8-0ebc-41c3-b1d5-0624dc9c62dd service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Received event network-vif-deleted-258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:48 user nova-compute[75342]: INFO nova.compute.manager [req-b632c708-50ca-4656-837a-b3a2deb71160 req-5ee7e5c8-0ebc-41c3-b1d5-0624dc9c62dd service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Neutron deleted interface 258320a2-30f7-4c04-bb9f-49a4caa90b3f; detaching it from the instance and deleting it from the info cache
Nov 16 18:08:48 user nova-compute[75342]: DEBUG nova.network.neutron [req-b632c708-50ca-4656-837a-b3a2deb71160 req-5ee7e5c8-0ebc-41c3-b1d5-0624dc9c62dd service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-b632c708-50ca-4656-837a-b3a2deb71160 req-5ee7e5c8-0ebc-41c3-b1d5-0624dc9c62dd service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Detach interface failed, port_id=258320a2-30f7-4c04-bb9f-49a4caa90b3f, reason: Instance 218bd8cd-58a5-40b3-a989-5aea6a5c9c43 could not be found. {{(pid=75342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:08:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:48 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Deleted allocations for instance 218bd8cd-58a5-40b3-a989-5aea6a5c9c43
Nov 16 18:08:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6ca16f77-8495-4024-aed3-a4b7218cc229 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781 tempest-TestServerVolumeAttachScenarioOldVersion-1722200781-project-member] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.389s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-4d91d831-0072-4faa-9a14-716c4bc5ca9e req-ffa50055-ad6f-422b-b180-69250134f006 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Received event network-vif-plugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4d91d831-0072-4faa-9a14-716c4bc5ca9e req-ffa50055-ad6f-422b-b180-69250134f006 service nova] Acquiring lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4d91d831-0072-4faa-9a14-716c4bc5ca9e req-ffa50055-ad6f-422b-b180-69250134f006 service nova] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4d91d831-0072-4faa-9a14-716c4bc5ca9e req-ffa50055-ad6f-422b-b180-69250134f006 service nova] Lock "218bd8cd-58a5-40b3-a989-5aea6a5c9c43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-4d91d831-0072-4faa-9a14-716c4bc5ca9e req-ffa50055-ad6f-422b-b180-69250134f006 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] No waiting events found dispatching network-vif-plugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:49 user nova-compute[75342]: WARNING nova.compute.manager [req-4d91d831-0072-4faa-9a14-716c4bc5ca9e req-ffa50055-ad6f-422b-b180-69250134f006 service nova] [instance: 218bd8cd-58a5-40b3-a989-5aea6a5c9c43] Received unexpected event network-vif-plugged-258320a2-30f7-4c04-bb9f-49a4caa90b3f for instance with vm_state deleted and task_state None.
Nov 16 18:08:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26237303736303332', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237303736303332', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG nova.objects.instance [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:08:49 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:08:49 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:08:49 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:08:49 user nova-compute[75342]:   <serial>ed80d9c2-3208-4679-8fd7-b350b2ab807e</serial>
Nov 16 18:08:49 user nova-compute[75342]: </disk>
Nov 16 18:08:49 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No VIF found with MAC fa:16:3e:3f:c1:5a, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:08:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-aafae9b2-507a-4cb5-909c-d9635a0f9e7b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.275s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8ae0fbb4-dd66-4c16-9fd1-4ee492620c10 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8ae0fbb4-dd66-4c16-9fd1-4ee492620c10 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8ae0fbb4-dd66-4c16-9fd1-4ee492620c10 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8ae0fbb4-dd66-4c16-9fd1-4ee492620c10 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75342) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8ae0fbb4-dd66-4c16-9fd1-4ee492620c10 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-ede7e5f1-ac3f-40f3-bdd3-acd1fb4b76fa req-bd7e0cbf-34c2-41d1-ae1d-67c20847f2f8 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-unplugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ede7e5f1-ac3f-40f3-bdd3-acd1fb4b76fa req-bd7e0cbf-34c2-41d1-ae1d-67c20847f2f8 service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ede7e5f1-ac3f-40f3-bdd3-acd1fb4b76fa req-bd7e0cbf-34c2-41d1-ae1d-67c20847f2f8 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ede7e5f1-ac3f-40f3-bdd3-acd1fb4b76fa req-bd7e0cbf-34c2-41d1-ae1d-67c20847f2f8 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-ede7e5f1-ac3f-40f3-bdd3-acd1fb4b76fa req-bd7e0cbf-34c2-41d1-ae1d-67c20847f2f8 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-unplugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:50 user nova-compute[75342]: WARNING nova.compute.manager [req-ede7e5f1-ac3f-40f3-bdd3-acd1fb4b76fa req-bd7e0cbf-34c2-41d1-ae1d-67c20847f2f8 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received unexpected event network-vif-unplugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with vm_state active and task_state powering-off.
Nov 16 18:08:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:50 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance destroyed successfully.
Nov 16 18:08:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8ae0fbb4-dd66-4c16-9fd1-4ee492620c10 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:08:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8ae0fbb4-dd66-4c16-9fd1-4ee492620c10 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.980s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-52be6846-91c2-4c63-a7c6-1cec38ec5478 req-d921da7b-5812-4882-a8e9-dd420c93a905 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:08:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-52be6846-91c2-4c63-a7c6-1cec38ec5478 req-d921da7b-5812-4882-a8e9-dd420c93a905 service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:08:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-52be6846-91c2-4c63-a7c6-1cec38ec5478 req-d921da7b-5812-4882-a8e9-dd420c93a905 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:08:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-52be6846-91c2-4c63-a7c6-1cec38ec5478 req-d921da7b-5812-4882-a8e9-dd420c93a905 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:08:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-52be6846-91c2-4c63-a7c6-1cec38ec5478 req-d921da7b-5812-4882-a8e9-dd420c93a905 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:08:52 user nova-compute[75342]: WARNING nova.compute.manager [req-52be6846-91c2-4c63-a7c6-1cec38ec5478 req-d921da7b-5812-4882-a8e9-dd420c93a905 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received unexpected event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with vm_state stopped and task_state None.
Nov 16 18:08:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:08:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "645e4341-403d-461d-9111-a8046ae4feb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "645e4341-403d-461d-9111-a8046ae4feb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:09:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:09:00 user nova-compute[75342]: INFO nova.compute.claims [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Claim successful on node user
Nov 16 18:09:01 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:09:01 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:09:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG nova.policy [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd02be1850ee43f8943d236ed1093864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9d3323184440bfa3a59fe001304b3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:09:01 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Creating image(s)
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "/opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "/opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "/opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk 1073741824" returned: 0 in 0.047s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Successfully created port: e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Checking if we can resize image /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Cannot resize image /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Ensure instance console log exists: /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Successfully updated port: e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "refresh_cache-645e4341-403d-461d-9111-a8046ae4feb8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquired lock "refresh_cache-645e4341-403d-461d-9111-a8046ae4feb8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-1bcc3235-67b8-493c-a8c4-c12fc186d989 req-f209feda-b419-4c5a-b0ce-423c5d592c0d service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Received event network-changed-e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-1bcc3235-67b8-493c-a8c4-c12fc186d989 req-f209feda-b419-4c5a-b0ce-423c5d592c0d service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Refreshing instance network info cache due to event network-changed-e053a2ca-777d-43d7-b791-3978c489ef2e. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1bcc3235-67b8-493c-a8c4-c12fc186d989 req-f209feda-b419-4c5a-b0ce-423c5d592c0d service nova] Acquiring lock "refresh_cache-645e4341-403d-461d-9111-a8046ae4feb8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:09:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Updating instance_info_cache with network_info: [{"id": "e053a2ca-777d-43d7-b791-3978c489ef2e", "address": "fa:16:3e:ad:91:f0", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape053a2ca-77", "ovs_interfaceid": "e053a2ca-777d-43d7-b791-3978c489ef2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Releasing lock "refresh_cache-645e4341-403d-461d-9111-a8046ae4feb8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Instance network_info: |[{"id": "e053a2ca-777d-43d7-b791-3978c489ef2e", "address": "fa:16:3e:ad:91:f0", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape053a2ca-77", "ovs_interfaceid": "e053a2ca-777d-43d7-b791-3978c489ef2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1bcc3235-67b8-493c-a8c4-c12fc186d989 req-f209feda-b419-4c5a-b0ce-423c5d592c0d service nova] Acquired lock "refresh_cache-645e4341-403d-461d-9111-a8046ae4feb8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.network.neutron [req-1bcc3235-67b8-493c-a8c4-c12fc186d989 req-f209feda-b419-4c5a-b0ce-423c5d592c0d service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Refreshing network info cache for port e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Start _get_guest_xml network_info=[{"id": "e053a2ca-777d-43d7-b791-3978c489ef2e", "address": "fa:16:3e:ad:91:f0", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape053a2ca-77", "ovs_interfaceid": "e053a2ca-777d-43d7-b791-3978c489ef2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:09:03 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:09:03 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:09:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-722824667',display_name='tempest-VolumesActionsTest-instance-722824667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-722824667',id=27,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9d3323184440bfa3a59fe001304b3b',ramdisk_id='',reservation_id='r-yk9u0wq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1486004135',owner_user_name='tempest-VolumesActionsTest-1486004135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:09:01Z,user_data=None,user_id='fd02be1850ee43f8943d236ed1093864',uuid=645e4341-403d-461d-9111-a8046ae4feb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e053a2ca-777d-43d7-b791-3978c489ef2e", "address": "fa:16:3e:ad:91:f0", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape053a2ca-77", "ovs_interfaceid": "e053a2ca-777d-43d7-b791-3978c489ef2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converting VIF {"id": "e053a2ca-777d-43d7-b791-3978c489ef2e", "address": "fa:16:3e:ad:91:f0", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape053a2ca-77", "ovs_interfaceid": "e053a2ca-777d-43d7-b791-3978c489ef2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:91:f0,bridge_name='br-int',has_traffic_filtering=True,id=e053a2ca-777d-43d7-b791-3978c489ef2e,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape053a2ca-77') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.objects.instance [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lazy-loading 'pci_devices' on Instance uuid 645e4341-403d-461d-9111-a8046ae4feb8 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:09:03 user nova-compute[75342]:   <uuid>645e4341-403d-461d-9111-a8046ae4feb8</uuid>
Nov 16 18:09:03 user nova-compute[75342]:   <name>instance-0000001b</name>
Nov 16 18:09:03 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:09:03 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:09:03 user nova-compute[75342]:   <metadata>
Nov 16 18:09:03 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:09:03 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:09:03 user nova-compute[75342]:       <nova:name>tempest-VolumesActionsTest-instance-722824667</nova:name>
Nov 16 18:09:03 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:09:03</nova:creationTime>
Nov 16 18:09:03 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:09:03 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:09:03 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:09:03 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:09:03 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:09:03 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:09:03 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:09:03 user nova-compute[75342]:       <nova:owner>
Nov 16 18:09:03 user nova-compute[75342]:         <nova:user uuid="fd02be1850ee43f8943d236ed1093864">tempest-VolumesActionsTest-1486004135-project-member</nova:user>
Nov 16 18:09:03 user nova-compute[75342]:         <nova:project uuid="ab9d3323184440bfa3a59fe001304b3b">tempest-VolumesActionsTest-1486004135</nova:project>
Nov 16 18:09:03 user nova-compute[75342]:       </nova:owner>
Nov 16 18:09:03 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:09:03 user nova-compute[75342]:       <nova:ports>
Nov 16 18:09:03 user nova-compute[75342]:         <nova:port uuid="e053a2ca-777d-43d7-b791-3978c489ef2e">
Nov 16 18:09:03 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 18:09:03 user nova-compute[75342]:         </nova:port>
Nov 16 18:09:03 user nova-compute[75342]:       </nova:ports>
Nov 16 18:09:03 user nova-compute[75342]:     </nova:instance>
Nov 16 18:09:03 user nova-compute[75342]:   </metadata>
Nov 16 18:09:03 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:09:03 user nova-compute[75342]:     <system>
Nov 16 18:09:03 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:09:03 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:09:03 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:09:03 user nova-compute[75342]:       <entry name="serial">645e4341-403d-461d-9111-a8046ae4feb8</entry>
Nov 16 18:09:03 user nova-compute[75342]:       <entry name="uuid">645e4341-403d-461d-9111-a8046ae4feb8</entry>
Nov 16 18:09:03 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:09:03 user nova-compute[75342]:     </system>
Nov 16 18:09:03 user nova-compute[75342]:   </sysinfo>
Nov 16 18:09:03 user nova-compute[75342]:   <os>
Nov 16 18:09:03 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:09:03 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:09:03 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:09:03 user nova-compute[75342]:   </os>
Nov 16 18:09:03 user nova-compute[75342]:   <features>
Nov 16 18:09:03 user nova-compute[75342]:     <acpi/>
Nov 16 18:09:03 user nova-compute[75342]:     <apic/>
Nov 16 18:09:03 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:09:03 user nova-compute[75342]:   </features>
Nov 16 18:09:03 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:09:03 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:09:03 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:09:03 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:09:03 user nova-compute[75342]:   </clock>
Nov 16 18:09:03 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:09:03 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:09:03 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:09:03 user nova-compute[75342]:   </cpu>
Nov 16 18:09:03 user nova-compute[75342]:   <devices>
Nov 16 18:09:03 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:09:03 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:09:03 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk"/>
Nov 16 18:09:03 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:09:03 user nova-compute[75342]:     </disk>
Nov 16 18:09:03 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:09:03 user nova-compute[75342]:       <mac address="fa:16:3e:ad:91:f0"/>
Nov 16 18:09:03 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:09:03 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:09:03 user nova-compute[75342]:       <target dev="tape053a2ca-77"/>
Nov 16 18:09:03 user nova-compute[75342]:     </interface>
Nov 16 18:09:03 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:09:03 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/console.log" append="off"/>
Nov 16 18:09:03 user nova-compute[75342]:     </serial>
Nov 16 18:09:03 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:09:03 user nova-compute[75342]:     <video>
Nov 16 18:09:03 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:09:03 user nova-compute[75342]:     </video>
Nov 16 18:09:03 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:09:03 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:09:03 user nova-compute[75342]:     </rng>
Nov 16 18:09:03 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:09:03 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:09:03 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:09:03 user nova-compute[75342]:     </memballoon>
Nov 16 18:09:03 user nova-compute[75342]:   </devices>
Nov 16 18:09:03 user nova-compute[75342]: </domain>
Nov 16 18:09:03 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:09:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-722824667',display_name='tempest-VolumesActionsTest-instance-722824667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-722824667',id=27,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9d3323184440bfa3a59fe001304b3b',ramdisk_id='',reservation_id='r-yk9u0wq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1486004135',owner_user_name='tempest-VolumesActionsTest-1486004135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:09:01Z,user_data=None,user_id='fd02be1850ee43f8943d236ed1093864',uuid=645e4341-403d-461d-9111-a8046ae4feb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e053a2ca-777d-43d7-b791-3978c489ef2e", "address": "fa:16:3e:ad:91:f0", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape053a2ca-77", "ovs_interfaceid": "e053a2ca-777d-43d7-b791-3978c489ef2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converting VIF {"id": "e053a2ca-777d-43d7-b791-3978c489ef2e", "address": "fa:16:3e:ad:91:f0", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape053a2ca-77", "ovs_interfaceid": "e053a2ca-777d-43d7-b791-3978c489ef2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:91:f0,bridge_name='br-int',has_traffic_filtering=True,id=e053a2ca-777d-43d7-b791-3978c489ef2e,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape053a2ca-77') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG os_vif [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:91:f0,bridge_name='br-int',has_traffic_filtering=True,id=e053a2ca-777d-43d7-b791-3978c489ef2e,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape053a2ca-77') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8297e9c-2e5c-5789-9aed-3f2b869b852b', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape053a2ca-77, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape053a2ca-77, col_values=(('qos', UUID('1b7f6eb7-04a7-4355-8154-8651da80a95a')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape053a2ca-77, col_values=(('external_ids', {'iface-id': 'e053a2ca-777d-43d7-b791-3978c489ef2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:91:f0', 'vm-uuid': '645e4341-403d-461d-9111-a8046ae4feb8'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:03 user nova-compute[75342]: INFO os_vif [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:91:f0,bridge_name='br-int',has_traffic_filtering=True,id=e053a2ca-777d-43d7-b791-3978c489ef2e,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape053a2ca-77')
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] No VIF found with MAC fa:16:3e:ad:91:f0, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.network.neutron [req-1bcc3235-67b8-493c-a8c4-c12fc186d989 req-f209feda-b419-4c5a-b0ce-423c5d592c0d service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Updated VIF entry in instance network info cache for port e053a2ca-777d-43d7-b791-3978c489ef2e. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG nova.network.neutron [req-1bcc3235-67b8-493c-a8c4-c12fc186d989 req-f209feda-b419-4c5a-b0ce-423c5d592c0d service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Updating instance_info_cache with network_info: [{"id": "e053a2ca-777d-43d7-b791-3978c489ef2e", "address": "fa:16:3e:ad:91:f0", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape053a2ca-77", "ovs_interfaceid": "e053a2ca-777d-43d7-b791-3978c489ef2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:09:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1bcc3235-67b8-493c-a8c4-c12fc186d989 req-f209feda-b419-4c5a-b0ce-423c5d592c0d service nova] Releasing lock "refresh_cache-645e4341-403d-461d-9111-a8046ae4feb8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:09:04 user nova-compute[75342]: INFO nova.compute.claims [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Claim successful on node user
Nov 16 18:09:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-da1f24a2-ed2c-4d4a-accf-369f7a69ead3 req-928686a9-40da-46c8-83db-b317941dac67 service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Received event network-vif-plugged-e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-da1f24a2-ed2c-4d4a-accf-369f7a69ead3 req-928686a9-40da-46c8-83db-b317941dac67 service nova] Acquiring lock "645e4341-403d-461d-9111-a8046ae4feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-da1f24a2-ed2c-4d4a-accf-369f7a69ead3 req-928686a9-40da-46c8-83db-b317941dac67 service nova] Lock "645e4341-403d-461d-9111-a8046ae4feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-da1f24a2-ed2c-4d4a-accf-369f7a69ead3 req-928686a9-40da-46c8-83db-b317941dac67 service nova] Lock "645e4341-403d-461d-9111-a8046ae4feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-da1f24a2-ed2c-4d4a-accf-369f7a69ead3 req-928686a9-40da-46c8-83db-b317941dac67 service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] No waiting events found dispatching network-vif-plugged-e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:09:04 user nova-compute[75342]: WARNING nova.compute.manager [req-da1f24a2-ed2c-4d4a-accf-369f7a69ead3 req-928686a9-40da-46c8-83db-b317941dac67 service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Received unexpected event network-vif-plugged-e053a2ca-777d-43d7-b791-3978c489ef2e for instance with vm_state building and task_state spawning.
Nov 16 18:09:05 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:09:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:09:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG nova.policy [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '062cd6d338014493be6c40701d2a735b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d44dce2b444ef386b47927d5c70c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:09:05 user nova-compute[75342]: INFO nova.virt.block_device [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Booting with volume b9908719-551d-4b1e-a106-828142f801f1 at /dev/vda
Nov 16 18:09:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG os_brick.utils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[20869413-a3e0-4ee3-b2c0-21ddb9a29d66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26802e3-298e-4bdf-8edc-3f38f65fa69c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f0ec18-4b2b-4860-af89-6e1fd2bf0ee0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f10e9f-0c23-4496-b5ba-cc0f742d2ad3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:09:05 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:09:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abdbf84-331a-4117-ab3d-d741a55c9acb]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG os_brick.utils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Updating existing volume attachment record: de66afb8-94d8-4a29-8fa1-6dd9e2b71f6c {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:09:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Successfully created port: 4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.network.neutron [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Successfully updated port: 4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "refresh_cache-1ce7aa5b-319e-4167-afc8-bcacd55fd794" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquired lock "refresh_cache-1ce7aa5b-319e-4167-afc8-bcacd55fd794" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.network.neutron [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.network.neutron [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.network.neutron [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Updating instance_info_cache with network_info: [{"id": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "address": "fa:16:3e:0a:cd:6c", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e36c11c-a2", "ovs_interfaceid": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Releasing lock "refresh_cache-1ce7aa5b-319e-4167-afc8-bcacd55fd794" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Instance network_info: |[{"id": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "address": "fa:16:3e:0a:cd:6c", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e36c11c-a2", "ovs_interfaceid": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:09:06 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Instance spawned successfully.
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:07 user nova-compute[75342]: INFO nova.compute.manager [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 16 18:09:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Received event network-vif-plugged-e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] Acquiring lock "645e4341-403d-461d-9111-a8046ae4feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] Lock "645e4341-403d-461d-9111-a8046ae4feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] Lock "645e4341-403d-461d-9111-a8046ae4feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] No waiting events found dispatching network-vif-plugged-e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:09:07 user nova-compute[75342]: WARNING nova.compute.manager [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Received unexpected event network-vif-plugged-e053a2ca-777d-43d7-b791-3978c489ef2e for instance with vm_state building and task_state spawning.
Nov 16 18:09:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Received event network-changed-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Refreshing instance network info cache due to event network-changed-4e36c11c-a2ec-4447-bfcc-c120ceaa8338. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] Acquiring lock "refresh_cache-1ce7aa5b-319e-4167-afc8-bcacd55fd794" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] Acquired lock "refresh_cache-1ce7aa5b-319e-4167-afc8-bcacd55fd794" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Refreshing network info cache for port 4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:09:07 user nova-compute[75342]: INFO nova.compute.manager [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Took 6.25 seconds to build instance.
Nov 16 18:09:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bc5002b9-6a7c-4005-a1fc-38a43155a9d6 tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "645e4341-403d-461d-9111-a8046ae4feb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.341s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Updated VIF entry in instance network info cache for port 4e36c11c-a2ec-4447-bfcc-c120ceaa8338. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Updating instance_info_cache with network_info: [{"id": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "address": "fa:16:3e:0a:cd:6c", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e36c11c-a2", "ovs_interfaceid": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:09:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4252c18f-c99d-49f6-bed1-ddf1083c45ae req-d380b875-ea02-401f-9f91-aa91e6438d4e service nova] Releasing lock "refresh_cache-1ce7aa5b-319e-4167-afc8-bcacd55fd794" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:09:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:09:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Creating image(s)
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Ensure instance console log exists: /opt/stack/data/nova/instances/1ce7aa5b-319e-4167-afc8-bcacd55fd794/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Start _get_guest_xml network_info=[{"id": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "address": "fa:16:3e:0a:cd:6c", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e36c11c-a2", "ovs_interfaceid": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'de66afb8-94d8-4a29-8fa1-6dd9e2b71f6c', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEZBDqyz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ce7aa5b-319e-4167-afc8-bcacd55fd794', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9908719-551d-4b1e-a106-828142f801f1', 'serial': 'b9908719-551d-4b1e-a106-828142f801f1'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:09:10 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:09:10 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEZBDqyz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:09:10 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:09:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:09:10 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:09:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:09:10 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ec03e5-c7b7-4cc9-8492-c424ef8e38fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:09:10 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[050e4363-5041-4c63-8890-ec492be791eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1] added
Nov 16 18:09:10 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a421a5af-d165-46ec-9432-61c53acb2ac0]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[164e7467-818b-4560-b79e-4a0222f2b051]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEZBDqyz {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEZBDqyz" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea9a419-2376-4646-86ca-34e7201aa610]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sEZBDqyz'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:09:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[406eac95-7da7-4b9f-884a-1537924eecd0]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6e68c8-af9b-44c9-bc97-fb1366a6bdaa]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:09:11 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:09:11 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:09:11 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:09:11 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:09:11 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:09:11 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d0ede2-1a90-4689-80e4-668fe24d8537]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1, portal: 172.16.0.220,3260]
Nov 16 18:09:11 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1, portal: 172.16.0.220,3260] successful.
Nov 16 18:09:11 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[565ee525-84e7-4eec-81da-526c05c35727]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71295d1-cca7-4d1e-b85e-ecfdc660d998]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:09:11 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:09:11 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:09:11 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:09:11 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:09:11 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:09:11 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:09:11 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:09:11 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[319d403e-d83e-40ec-9155-e1621c90f2df]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:11 user nova-compute[75342]: INFO nova.compute.manager [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Terminating instance
Nov 16 18:09:11 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-b0a06275-9088-45bd-a228-02054c85117e req-44e29b42-ae6c-4421-9682-e75dc47cce54 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-vif-unplugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b0a06275-9088-45bd-a228-02054c85117e req-44e29b42-ae6c-4421-9682-e75dc47cce54 service nova] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b0a06275-9088-45bd-a228-02054c85117e req-44e29b42-ae6c-4421-9682-e75dc47cce54 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b0a06275-9088-45bd-a228-02054c85117e req-44e29b42-ae6c-4421-9682-e75dc47cce54 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-b0a06275-9088-45bd-a228-02054c85117e req-44e29b42-ae6c-4421-9682-e75dc47cce54 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] No waiting events found dispatching network-vif-unplugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-b0a06275-9088-45bd-a228-02054c85117e req-44e29b42-ae6c-4421-9682-e75dc47cce54 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-vif-unplugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEZBDqyz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23364393264303739', 'path': '/dev/sdc'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364393264303739', 'path': '/dev/sdc'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1687268475',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1687268475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1687268475',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw1xv74zn5ZgLcLpqsv13QtMcyML1iDaJpGrxH2X815ufey1ewK6UhKfQu+6DiHxuCDU0vPXDlDHjCf/HIcnJ5Sk+q9NMuRVlc3BqnAr/Q67DItNm7/6KWgEOWvE3CG7w==',key_name='tempest-keypair-1270973874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-fbeua5m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062cd6d338014493be6c40701d2a735b',uuid=1ce7aa5b-319e-4167-afc8-bcacd55fd794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "address": "fa:16:3e:0a:cd:6c", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e36c11c-a2", "ovs_interfaceid": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "address": "fa:16:3e:0a:cd:6c", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e36c11c-a2", "ovs_interfaceid": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cd:6c,bridge_name='br-int',has_traffic_filtering=True,id=4e36c11c-a2ec-4447-bfcc-c120ceaa8338,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e36c11c-a2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.objects.instance [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ce7aa5b-319e-4167-afc8-bcacd55fd794 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:09:12 user nova-compute[75342]:   <uuid>1ce7aa5b-319e-4167-afc8-bcacd55fd794</uuid>
Nov 16 18:09:12 user nova-compute[75342]:   <name>instance-0000001c</name>
Nov 16 18:09:12 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:09:12 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:09:12 user nova-compute[75342]:   <metadata>
Nov 16 18:09:12 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:09:12 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:09:12 user nova-compute[75342]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1687268475</nova:name>
Nov 16 18:09:12 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:09:10</nova:creationTime>
Nov 16 18:09:12 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:09:12 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:09:12 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:09:12 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:09:12 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:09:12 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:09:12 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:09:12 user nova-compute[75342]:       <nova:owner>
Nov 16 18:09:12 user nova-compute[75342]:         <nova:user uuid="062cd6d338014493be6c40701d2a735b">tempest-TestVolumeBootPattern-312873750-project-member</nova:user>
Nov 16 18:09:12 user nova-compute[75342]:         <nova:project uuid="46d44dce2b444ef386b47927d5c70c8e">tempest-TestVolumeBootPattern-312873750</nova:project>
Nov 16 18:09:12 user nova-compute[75342]:       </nova:owner>
Nov 16 18:09:12 user nova-compute[75342]:       <nova:ports>
Nov 16 18:09:12 user nova-compute[75342]:         <nova:port uuid="4e36c11c-a2ec-4447-bfcc-c120ceaa8338">
Nov 16 18:09:12 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 18:09:12 user nova-compute[75342]:         </nova:port>
Nov 16 18:09:12 user nova-compute[75342]:       </nova:ports>
Nov 16 18:09:12 user nova-compute[75342]:     </nova:instance>
Nov 16 18:09:12 user nova-compute[75342]:   </metadata>
Nov 16 18:09:12 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:09:12 user nova-compute[75342]:     <system>
Nov 16 18:09:12 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:09:12 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:09:12 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:09:12 user nova-compute[75342]:       <entry name="serial">1ce7aa5b-319e-4167-afc8-bcacd55fd794</entry>
Nov 16 18:09:12 user nova-compute[75342]:       <entry name="uuid">1ce7aa5b-319e-4167-afc8-bcacd55fd794</entry>
Nov 16 18:09:12 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:09:12 user nova-compute[75342]:     </system>
Nov 16 18:09:12 user nova-compute[75342]:   </sysinfo>
Nov 16 18:09:12 user nova-compute[75342]:   <os>
Nov 16 18:09:12 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:09:12 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:09:12 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:09:12 user nova-compute[75342]:   </os>
Nov 16 18:09:12 user nova-compute[75342]:   <features>
Nov 16 18:09:12 user nova-compute[75342]:     <acpi/>
Nov 16 18:09:12 user nova-compute[75342]:     <apic/>
Nov 16 18:09:12 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:09:12 user nova-compute[75342]:   </features>
Nov 16 18:09:12 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:09:12 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:09:12 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:09:12 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:09:12 user nova-compute[75342]:   </clock>
Nov 16 18:09:12 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:09:12 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:09:12 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:09:12 user nova-compute[75342]:   </cpu>
Nov 16 18:09:12 user nova-compute[75342]:   <devices>
Nov 16 18:09:12 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:09:12 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:09:12 user nova-compute[75342]:       <source dev="/dev/sdc"/>
Nov 16 18:09:12 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:09:12 user nova-compute[75342]:       <serial>b9908719-551d-4b1e-a106-828142f801f1</serial>
Nov 16 18:09:12 user nova-compute[75342]:     </disk>
Nov 16 18:09:12 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:09:12 user nova-compute[75342]:       <mac address="fa:16:3e:0a:cd:6c"/>
Nov 16 18:09:12 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:09:12 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:09:12 user nova-compute[75342]:       <target dev="tap4e36c11c-a2"/>
Nov 16 18:09:12 user nova-compute[75342]:     </interface>
Nov 16 18:09:12 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:09:12 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/1ce7aa5b-319e-4167-afc8-bcacd55fd794/console.log" append="off"/>
Nov 16 18:09:12 user nova-compute[75342]:     </serial>
Nov 16 18:09:12 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:09:12 user nova-compute[75342]:     <video>
Nov 16 18:09:12 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:09:12 user nova-compute[75342]:     </video>
Nov 16 18:09:12 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:09:12 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:09:12 user nova-compute[75342]:     </rng>
Nov 16 18:09:12 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:09:12 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:09:12 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:09:12 user nova-compute[75342]:     </memballoon>
Nov 16 18:09:12 user nova-compute[75342]:   </devices>
Nov 16 18:09:12 user nova-compute[75342]: </domain>
Nov 16 18:09:12 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1687268475',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1687268475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1687268475',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw1xv74zn5ZgLcLpqsv13QtMcyML1iDaJpGrxH2X815ufey1ewK6UhKfQu+6DiHxuCDU0vPXDlDHjCf/HIcnJ5Sk+q9NMuRVlc3BqnAr/Q67DItNm7/6KWgEOWvE3CG7w==',key_name='tempest-keypair-1270973874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-fbeua5m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062cd6d338014493be6c40701d2a735b',uuid=1ce7aa5b-319e-4167-afc8-bcacd55fd794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "address": "fa:16:3e:0a:cd:6c", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e36c11c-a2", "ovs_interfaceid": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "address": "fa:16:3e:0a:cd:6c", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e36c11c-a2", "ovs_interfaceid": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cd:6c,bridge_name='br-int',has_traffic_filtering=True,id=4e36c11c-a2ec-4447-bfcc-c120ceaa8338,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e36c11c-a2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG os_vif [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cd:6c,bridge_name='br-int',has_traffic_filtering=True,id=4e36c11c-a2ec-4447-bfcc-c120ceaa8338,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e36c11c-a2') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f59e60c3-6cfe-5b59-9294-9c9c4182d20c', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:09:12 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Instance destroyed successfully.
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'resources' on Instance uuid 28eaadcb-3f00-4868-8115-b5d4ba9454f3 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-887107635',display_name='tempest-ServerActionsTestOtherA-server-1533163224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-887107635',id=17,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfwGnGzjoPuBYsLqsfQN6FM2vWnqcustRrTtZq3OicWLSB8yxCZthWTbl8eXWTXVUw2kpzZCI19a2sTDkWmNjVlQEF1Pk/zLU8VOzU8Glz1gUKzzWAUC1g4Kb4M6bYDqQ==',key_name='tempest-keypair-1194151370',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:05:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-8109rq0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:05:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=28eaadcb-3f00-4868-8115-b5d4ba9454f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "address": "fa:16:3e:3c:3d:18", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10735e2-a2", "ovs_interfaceid": "f10735e2-a261-4be2-9fc4-2ae2622116b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG os_vif [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf10735e2-a2, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e36c11c-a2, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e36c11c-a2, col_values=(('qos', UUID('18662f50-14ae-485a-8a7a-0d2ef43f9d62')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e36c11c-a2, col_values=(('external_ids', {'iface-id': '4e36c11c-a2ec-4447-bfcc-c120ceaa8338', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:cd:6c', 'vm-uuid': '1ce7aa5b-319e-4167-afc8-bcacd55fd794'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: INFO os_vif [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cd:6c,bridge_name='br-int',has_traffic_filtering=True,id=4e36c11c-a2ec-4447-bfcc-c120ceaa8338,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e36c11c-a2')
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05b8fe6b-4cd0-4b84-bfb5-f3ae57916127) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:12 user nova-compute[75342]: INFO os_vif [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:3d:18,bridge_name='br-int',has_traffic_filtering=True,id=f10735e2-a261-4be2-9fc4-2ae2622116b1,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10735e2-a2')
Nov 16 18:09:12 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Deleting instance files /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3_del
Nov 16 18:09:12 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Deletion of /opt/stack/data/nova/instances/28eaadcb-3f00-4868-8115-b5d4ba9454f3_del complete
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No VIF found with MAC fa:16:3e:0a:cd:6c, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:09:12 user nova-compute[75342]: INFO nova.compute.manager [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 16 18:09:12 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:09:12 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:09:13 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Took 0.71 seconds to deallocate network for instance.
Nov 16 18:09:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-fdd36df1-5090-4e7e-a40b-6eb6a74f9066 req-df2ec9aa-2760-4916-ad61-f682d30d0525 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-vif-deleted-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:13 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Deleted allocations for instance 28eaadcb-3f00-4868-8115-b5d4ba9454f3
Nov 16 18:09:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b5216ea4-9d54-4f7e-afdd-64ebbefd810b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-cc39bf62-aa4f-4dab-bbb9-6a2f6db9e6ea req-0f3a7a18-3255-4e0e-90ce-4a3e9d3b1731 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Received event network-vif-plugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cc39bf62-aa4f-4dab-bbb9-6a2f6db9e6ea req-0f3a7a18-3255-4e0e-90ce-4a3e9d3b1731 service nova] Acquiring lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cc39bf62-aa4f-4dab-bbb9-6a2f6db9e6ea req-0f3a7a18-3255-4e0e-90ce-4a3e9d3b1731 service nova] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cc39bf62-aa4f-4dab-bbb9-6a2f6db9e6ea req-0f3a7a18-3255-4e0e-90ce-4a3e9d3b1731 service nova] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-cc39bf62-aa4f-4dab-bbb9-6a2f6db9e6ea req-0f3a7a18-3255-4e0e-90ce-4a3e9d3b1731 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] No waiting events found dispatching network-vif-plugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:09:13 user nova-compute[75342]: WARNING nova.compute.manager [req-cc39bf62-aa4f-4dab-bbb9-6a2f6db9e6ea req-0f3a7a18-3255-4e0e-90ce-4a3e9d3b1731 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Received unexpected event network-vif-plugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 for instance with vm_state building and task_state spawning.
Nov 16 18:09:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-e61ac1d1-69c2-496a-816b-1b6aaa5cfdfc req-57675db7-6ec0-419c-9695-733c7c5dfb57 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e61ac1d1-69c2-496a-816b-1b6aaa5cfdfc req-57675db7-6ec0-419c-9695-733c7c5dfb57 service nova] Acquiring lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e61ac1d1-69c2-496a-816b-1b6aaa5cfdfc req-57675db7-6ec0-419c-9695-733c7c5dfb57 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e61ac1d1-69c2-496a-816b-1b6aaa5cfdfc req-57675db7-6ec0-419c-9695-733c7c5dfb57 service nova] Lock "28eaadcb-3f00-4868-8115-b5d4ba9454f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-e61ac1d1-69c2-496a-816b-1b6aaa5cfdfc req-57675db7-6ec0-419c-9695-733c7c5dfb57 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] No waiting events found dispatching network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:09:13 user nova-compute[75342]: WARNING nova.compute.manager [req-e61ac1d1-69c2-496a-816b-1b6aaa5cfdfc req-57675db7-6ec0-419c-9695-733c7c5dfb57 service nova] [instance: 28eaadcb-3f00-4868-8115-b5d4ba9454f3] Received unexpected event network-vif-plugged-f10735e2-a261-4be2-9fc4-2ae2622116b1 for instance with vm_state deleted and task_state None.
Nov 16 18:09:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:09:15 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Instance spawned successfully.
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:09:15 user nova-compute[75342]: INFO nova.compute.manager [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:09:15 user nova-compute[75342]: INFO nova.compute.manager [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Took 11.42 seconds to build instance.
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-d4bc89cf-87ad-4780-a6d5-d8d1643c0054 req-dbcb0c16-b4be-48d1-8afe-8f67c8e21e86 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Received event network-vif-plugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d4bc89cf-87ad-4780-a6d5-d8d1643c0054 req-dbcb0c16-b4be-48d1-8afe-8f67c8e21e86 service nova] Acquiring lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d4bc89cf-87ad-4780-a6d5-d8d1643c0054 req-dbcb0c16-b4be-48d1-8afe-8f67c8e21e86 service nova] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d4bc89cf-87ad-4780-a6d5-d8d1643c0054 req-dbcb0c16-b4be-48d1-8afe-8f67c8e21e86 service nova] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-d4bc89cf-87ad-4780-a6d5-d8d1643c0054 req-dbcb0c16-b4be-48d1-8afe-8f67c8e21e86 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] No waiting events found dispatching network-vif-plugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:09:15 user nova-compute[75342]: WARNING nova.compute.manager [req-d4bc89cf-87ad-4780-a6d5-d8d1643c0054 req-dbcb0c16-b4be-48d1-8afe-8f67c8e21e86 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Received unexpected event network-vif-plugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 for instance with vm_state active and task_state None.
Nov 16 18:09:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34c98c98-2349-42ac-a51c-337915cec04f tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.528s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:34 user nova-compute[75342]: INFO nova.compute.manager [None req-968860a5-f94e-401b-b59e-2ff596a9375d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Unrescuing
Nov 16 18:09:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-968860a5-f94e-401b-b59e-2ff596a9375d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:09:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-968860a5-f94e-401b-b59e-2ff596a9375d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquired lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:09:34 user nova-compute[75342]: DEBUG nova.network.neutron [None req-968860a5-f94e-401b-b59e-2ff596a9375d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:09:34 user nova-compute[75342]: DEBUG nova.network.neutron [None req-968860a5-f94e-401b-b59e-2ff596a9375d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Updating instance_info_cache with network_info: [{"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:09:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-968860a5-f94e-401b-b59e-2ff596a9375d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Releasing lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:09:34 user nova-compute[75342]: DEBUG nova.objects.instance [None req-968860a5-f94e-401b-b59e-2ff596a9375d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'flavor' on Instance uuid d0385123-12ff-41a3-a78d-ac5ce325ae0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:09:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-94ef2e6b-d6ea-4b04-bf1e-55344bfa98b9 req-76ed4642-7054-4659-bc29-a6fffca5b44a service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-unplugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-94ef2e6b-d6ea-4b04-bf1e-55344bfa98b9 req-76ed4642-7054-4659-bc29-a6fffca5b44a service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-94ef2e6b-d6ea-4b04-bf1e-55344bfa98b9 req-76ed4642-7054-4659-bc29-a6fffca5b44a service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-94ef2e6b-d6ea-4b04-bf1e-55344bfa98b9 req-76ed4642-7054-4659-bc29-a6fffca5b44a service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-94ef2e6b-d6ea-4b04-bf1e-55344bfa98b9 req-76ed4642-7054-4659-bc29-a6fffca5b44a service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-unplugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:09:35 user nova-compute[75342]: WARNING nova.compute.manager [req-94ef2e6b-d6ea-4b04-bf1e-55344bfa98b9 req-76ed4642-7054-4659-bc29-a6fffca5b44a service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received unexpected event network-vif-unplugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:09:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:35 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Instance destroyed successfully.
Nov 16 18:09:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-58b2f5e8-2abe-4000-b8d1-87380b7cd5a0 req-f9f4b203-a0d0-42a9-be21-961b0af2dc46 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58b2f5e8-2abe-4000-b8d1-87380b7cd5a0 req-f9f4b203-a0d0-42a9-be21-961b0af2dc46 service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58b2f5e8-2abe-4000-b8d1-87380b7cd5a0 req-f9f4b203-a0d0-42a9-be21-961b0af2dc46 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-58b2f5e8-2abe-4000-b8d1-87380b7cd5a0 req-f9f4b203-a0d0-42a9-be21-961b0af2dc46 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-58b2f5e8-2abe-4000-b8d1-87380b7cd5a0 req-f9f4b203-a0d0-42a9-be21-961b0af2dc46 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:09:37 user nova-compute[75342]: WARNING nova.compute.manager [req-58b2f5e8-2abe-4000-b8d1-87380b7cd5a0 req-f9f4b203-a0d0-42a9-be21-961b0af2dc46 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received unexpected event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:09:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:09:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:09:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:09:37 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:09:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:38 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:09:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:09:39 user nova-compute[75342]: WARNING nova.compute.manager [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received unexpected event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:09:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:09:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:09:39 user nova-compute[75342]: WARNING nova.compute.manager [req-f454d4be-ec92-453a-9c57-5fc84c4ef996 req-a808b2b6-7ba2-43aa-9451-f686a9595a0f service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received unexpected event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:09:39 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:09:39 user nova-compute[75342]: DEBUG nova.compute.manager [None req-968860a5-f94e-401b-b59e-2ff596a9375d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:09:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:41 user nova-compute[75342]: INFO nova.compute.manager [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Detaching volume e1508f04-5d7c-4fd6-bc91-c1c1884596e0
Nov 16 18:09:41 user nova-compute[75342]: INFO nova.virt.block_device [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Attempting to driver detach volume e1508f04-5d7c-4fd6-bc91-c1c1884596e0 from mountpoint /dev/vdc
Nov 16 18:09:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Attempting to detach device vdc from instance fb00d09d-d7c3-43f8-a118-26868011460b from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:09:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:09:41 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:09:41 user nova-compute[75342]:   <source dev="/dev/sdg"/>
Nov 16 18:09:41 user nova-compute[75342]:   <target dev="vdc" bus="virtio"/>
Nov 16 18:09:41 user nova-compute[75342]:   <serial>e1508f04-5d7c-4fd6-bc91-c1c1884596e0</serial>
Nov 16 18:09:41 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 18:09:41 user nova-compute[75342]: </disk>
Nov 16 18:09:41 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:09:41 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Successfully detached device vdc from instance fb00d09d-d7c3-43f8-a118-26868011460b from the persistent domain config.
Nov 16 18:09:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fb00d09d-d7c3-43f8-a118-26868011460b from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:09:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:09:41 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:09:41 user nova-compute[75342]:   <source dev="/dev/sdg"/>
Nov 16 18:09:41 user nova-compute[75342]:   <target dev="vdc" bus="virtio"/>
Nov 16 18:09:41 user nova-compute[75342]:   <serial>e1508f04-5d7c-4fd6-bc91-c1c1884596e0</serial>
Nov 16 18:09:41 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 18:09:41 user nova-compute[75342]: </disk>
Nov 16 18:09:41 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:09:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:09:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:09:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:09:47 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:09:47 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7584MB free_disk=25.222312927246094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c6408c85-ed86-4b11-afa6-14f93b92492c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance fb00d09d-d7c3-43f8-a118-26868011460b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 120e116f-a0e5-406c-9883-6f173da89100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 645e4341-403d-461d-9111-a8046ae4feb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 1ce7aa5b-319e-4167-afc8-bcacd55fd794 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:09:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:09:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:48 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:09:48 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:09:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:09:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:09:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:09:48 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:09:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Updating instance_info_cache with network_info: [{"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:09:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:09:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:09:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:09:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:09:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:02 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance fb00d09d-d7c3-43f8-a118-26868011460b is timed out.
Nov 16 18:10:02 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Successfully detached device vdc from instance fb00d09d-d7c3-43f8-a118-26868011460b from the live domain config.
Nov 16 18:10:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etgwqFpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:10:02 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce99ee78-f7bd-45bf-8607-e0e553ef5da3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:10:02 user nova-compute[75342]: No targets found.
Nov 16 18:10:02 user nova-compute[75342]: iSNS:
Nov 16 18:10:02 user nova-compute[75342]: No targets found.
Nov 16 18:10:02 user nova-compute[75342]: STATIC:
Nov 16 18:10:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e
Nov 16 18:10:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:10:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:10:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:10:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:10:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:10:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0
Nov 16 18:10:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:10:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:10:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1
Nov 16 18:10:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:10:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:10:02 user nova-compute[75342]: FIRMWARE:
Nov 16 18:10:02 user nova-compute[75342]: No targets found.
Nov 16 18:10:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:10:02 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:10:02 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[400154af-9e5e-415a-b5ed-782f5685aa79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc596fe-e2c5-436a-8b99-7e8e81c78561]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:02 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:10:02 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:10:02 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:02 user nova-compute[75342]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 (non-flash)
Nov 16 18:10:02 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:10:02 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4697520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0'): ({'sdg'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Removing single pathed devices sdg {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96a2468-c3fe-4001-8638-756316b43ba5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e54242-137a-479d-bdc5-61df234d6846]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Flushing IO for device /dev/sdg {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f6366-df0c-46e4-abaa-9d911a87bb6c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[078da7ff-db78-4d61-a2da-4d917f753057]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] SCSI volumes sdg have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ac2328-213f-43b4-aa87-9b2ffb2275e4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44492dc-5e74-422e-8a7f-14c61ad17a08]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0, portal: 172.16.0.220,3260]
Nov 16 18:10:02 user nova-compute[75342]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0, portal: 172.16.0.220,3260] successful.
Nov 16 18:10:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1508f04-5d7c-4fd6-bc91-c1c1884596e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c739e1b-bcfa-474d-8221-75269b5c05c9]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] <== disconnect_volume: return (335ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:10:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:10:03 user nova-compute[75342]: DEBUG nova.objects.instance [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'flavor' on Instance uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-31b6a40b-59ee-438c-b4f9-74d475b8acd5 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.899s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:10:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:10:05 user nova-compute[75342]: INFO nova.compute.claims [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Claim successful on node user
Nov 16 18:10:06 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:10:06 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:10:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG nova.policy [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba8b928d71ce4f918f0d5d6bd78b0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf819660602345c6acdb1caeff5bf347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:10:06 user nova-compute[75342]: INFO nova.virt.block_device [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Booting with volume a6258ccc-4998-46d4-b129-99252c6e5519 at /dev/vda
Nov 16 18:10:06 user nova-compute[75342]: DEBUG os_brick.utils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05a62b6-254a-46a2-8036-dcdf1935b949]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c421252-94bf-4c76-a8ca-a82a419d6222]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8022a24-9f98-4374-858f-bbf65b77442d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1246df26-9367-46ee-b60b-ac6a6ad18275]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:10:06 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:10:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2865963-ccac-4e9c-9bb4-4befef39d000]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG os_brick.utils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:10:06 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating existing volume attachment record: a0f1580b-752c-4dbd-964d-ebb490389c54 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:10:07 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Successfully created port: 1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:10:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:07 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Successfully updated port: 1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:10:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:10:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquired lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:10:07 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:10:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-ec72f152-1071-43bb-8ff5-0da6dcf9fff7 req-0386f6fe-7cdb-47eb-b6e1-70ca04981131 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-changed-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-ec72f152-1071-43bb-8ff5-0da6dcf9fff7 req-0386f6fe-7cdb-47eb-b6e1-70ca04981131 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Refreshing instance network info cache due to event network-changed-1f0e212f-0cb1-47be-b27f-90feb2b3568f. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:10:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ec72f152-1071-43bb-8ff5-0da6dcf9fff7 req-0386f6fe-7cdb-47eb-b6e1-70ca04981131 service nova] Acquiring lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:10:07 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:10:08 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating instance_info_cache with network_info: [{"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:10:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Releasing lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:10:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Instance network_info: |[{"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:10:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ec72f152-1071-43bb-8ff5-0da6dcf9fff7 req-0386f6fe-7cdb-47eb-b6e1-70ca04981131 service nova] Acquired lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:10:08 user nova-compute[75342]: DEBUG nova.network.neutron [req-ec72f152-1071-43bb-8ff5-0da6dcf9fff7 req-0386f6fe-7cdb-47eb-b6e1-70ca04981131 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Refreshing network info cache for port 1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:10:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:08 user nova-compute[75342]: DEBUG nova.network.neutron [req-ec72f152-1071-43bb-8ff5-0da6dcf9fff7 req-0386f6fe-7cdb-47eb-b6e1-70ca04981131 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updated VIF entry in instance network info cache for port 1f0e212f-0cb1-47be-b27f-90feb2b3568f. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:10:08 user nova-compute[75342]: DEBUG nova.network.neutron [req-ec72f152-1071-43bb-8ff5-0da6dcf9fff7 req-0386f6fe-7cdb-47eb-b6e1-70ca04981131 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating instance_info_cache with network_info: [{"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:10:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ec72f152-1071-43bb-8ff5-0da6dcf9fff7 req-0386f6fe-7cdb-47eb-b6e1-70ca04981131 service nova] Releasing lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:10:09 user nova-compute[75342]: DEBUG nova.compute.manager [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:10:09 user nova-compute[75342]: INFO nova.compute.manager [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] instance snapshotting
Nov 16 18:10:09 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Beginning live snapshot process
Nov 16 18:10:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json -f qcow2 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json -f qcow2 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmf9u9k5u/248b93b200114b229e5bdd4819e42ed5.delta 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmf9u9k5u/248b93b200114b229e5bdd4819e42ed5.delta 1073741824" returned: 0 in 0.048s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 18:10:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:10:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:10:11 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 18:10:11 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:10:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmf9u9k5u/248b93b200114b229e5bdd4819e42ed5.delta /opt/stack/data/nova/instances/snapshots/tmpmf9u9k5u/248b93b200114b229e5bdd4819e42ed5 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmf9u9k5u/248b93b200114b229e5bdd4819e42ed5.delta /opt/stack/data/nova/instances/snapshots/tmpmf9u9k5u/248b93b200114b229e5bdd4819e42ed5" returned: 0 in 0.659s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Snapshot extracted, beginning image upload
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:10:12 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Creating image(s)
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Ensure instance console log exists: /opt/stack/data/nova/instances/d4c63c32-8406-4498-b4de-8e8ecbc2a173/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Start _get_guest_xml network_info=[{"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a0f1580b-752c-4dbd-964d-ebb490389c54', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlBGrdDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd4c63c32-8406-4498-b4de-8e8ecbc2a173', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6258ccc-4998-46d4-b129-99252c6e5519', 'serial': 'a6258ccc-4998-46d4-b129-99252c6e5519'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:10:12 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:10:12 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlBGrdDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:10:12 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:10:12 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:10:12 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f76e84-4bfd-4f1a-925b-bf6b6fd13745]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:10:12 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07a55ca-49ae-4d3d-a518-9e609c55dc87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519] added
Nov 16 18:10:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d758dec8-eb21-40fb-a352-9f8141461cf8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[34526aee-ab2c-42a6-bce7-2226f65d24b8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlBGrdDP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlBGrdDP" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aedd85-55a8-477e-80c1-edcaab14d153]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XlBGrdDP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[593382d6-3e91-4804-b701-fbd2e58cacee]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e31e567-1b9b-4ae4-9376-d16139084cac]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:12 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:10:12 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:12 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:10:12 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8c21fd-34ea-4be6-8e32-b3101b19f05c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260]
Nov 16 18:10:12 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260] successful.
Nov 16 18:10:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e63750-77f0-481c-aae6-c94fd94b8941]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf95a1-ad24-4fdb-8f4d-cfe6b32f8410]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:12 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:10:12 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:12 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:10:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:12 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:10:12 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:12 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:10:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c67b9f2-f2b7-46a2-a042-f8a9ce4fee5b]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlBGrdDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23738626534666266', 'path': '/dev/sde'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738626534666266', 'path': '/dev/sde'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1011058480',display_name='tempest-TestShelveInstance-server-1011058480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1011058480',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiiI+Kbr7I++Ar7wZEVjMsGCaGZwXXvpVLemr4oPu6KcP5xOWW79PL8S3X7CGkmsoOgFJC/vOfwrrHTdTdEv1aDgavC1XoGmY0sba3f9D0T3rFUcp79le5MDwQtusWxOQ==',key_name='tempest-TestShelveInstance-2005458468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf819660602345c6acdb1caeff5bf347',ramdisk_id='',reservation_id='r-tij2s1qg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2088508252',owner_user_name='tempest-TestShelveInstance-2088508252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:10:06Z,user_data=None,user_id='ba8b928d71ce4f918f0d5d6bd78b0ebb',uuid=d4c63c32-8406-4498-b4de-8e8ecbc2a173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converting VIF {"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG nova.objects.instance [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lazy-loading 'pci_devices' on Instance uuid d4c63c32-8406-4498-b4de-8e8ecbc2a173 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:10:13 user nova-compute[75342]:   <uuid>d4c63c32-8406-4498-b4de-8e8ecbc2a173</uuid>
Nov 16 18:10:13 user nova-compute[75342]:   <name>instance-0000001d</name>
Nov 16 18:10:13 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:10:13 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:10:13 user nova-compute[75342]:   <metadata>
Nov 16 18:10:13 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:10:13 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:10:13 user nova-compute[75342]:       <nova:name>tempest-TestShelveInstance-server-1011058480</nova:name>
Nov 16 18:10:13 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:10:12</nova:creationTime>
Nov 16 18:10:13 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:10:13 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:10:13 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:10:13 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:10:13 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:10:13 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:10:13 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:10:13 user nova-compute[75342]:       <nova:owner>
Nov 16 18:10:13 user nova-compute[75342]:         <nova:user uuid="ba8b928d71ce4f918f0d5d6bd78b0ebb">tempest-TestShelveInstance-2088508252-project-member</nova:user>
Nov 16 18:10:13 user nova-compute[75342]:         <nova:project uuid="cf819660602345c6acdb1caeff5bf347">tempest-TestShelveInstance-2088508252</nova:project>
Nov 16 18:10:13 user nova-compute[75342]:       </nova:owner>
Nov 16 18:10:13 user nova-compute[75342]:       <nova:ports>
Nov 16 18:10:13 user nova-compute[75342]:         <nova:port uuid="1f0e212f-0cb1-47be-b27f-90feb2b3568f">
Nov 16 18:10:13 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 18:10:13 user nova-compute[75342]:         </nova:port>
Nov 16 18:10:13 user nova-compute[75342]:       </nova:ports>
Nov 16 18:10:13 user nova-compute[75342]:     </nova:instance>
Nov 16 18:10:13 user nova-compute[75342]:   </metadata>
Nov 16 18:10:13 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:10:13 user nova-compute[75342]:     <system>
Nov 16 18:10:13 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:10:13 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:10:13 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:10:13 user nova-compute[75342]:       <entry name="serial">d4c63c32-8406-4498-b4de-8e8ecbc2a173</entry>
Nov 16 18:10:13 user nova-compute[75342]:       <entry name="uuid">d4c63c32-8406-4498-b4de-8e8ecbc2a173</entry>
Nov 16 18:10:13 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:10:13 user nova-compute[75342]:     </system>
Nov 16 18:10:13 user nova-compute[75342]:   </sysinfo>
Nov 16 18:10:13 user nova-compute[75342]:   <os>
Nov 16 18:10:13 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:10:13 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:10:13 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:10:13 user nova-compute[75342]:   </os>
Nov 16 18:10:13 user nova-compute[75342]:   <features>
Nov 16 18:10:13 user nova-compute[75342]:     <acpi/>
Nov 16 18:10:13 user nova-compute[75342]:     <apic/>
Nov 16 18:10:13 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:10:13 user nova-compute[75342]:   </features>
Nov 16 18:10:13 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:10:13 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:10:13 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:10:13 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:10:13 user nova-compute[75342]:   </clock>
Nov 16 18:10:13 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:10:13 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:10:13 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:10:13 user nova-compute[75342]:   </cpu>
Nov 16 18:10:13 user nova-compute[75342]:   <devices>
Nov 16 18:10:13 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:10:13 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:10:13 user nova-compute[75342]:       <source dev="/dev/sde"/>
Nov 16 18:10:13 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:10:13 user nova-compute[75342]:       <serial>a6258ccc-4998-46d4-b129-99252c6e5519</serial>
Nov 16 18:10:13 user nova-compute[75342]:     </disk>
Nov 16 18:10:13 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:10:13 user nova-compute[75342]:       <mac address="fa:16:3e:88:5e:82"/>
Nov 16 18:10:13 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:10:13 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:10:13 user nova-compute[75342]:       <target dev="tap1f0e212f-0c"/>
Nov 16 18:10:13 user nova-compute[75342]:     </interface>
Nov 16 18:10:13 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:10:13 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/d4c63c32-8406-4498-b4de-8e8ecbc2a173/console.log" append="off"/>
Nov 16 18:10:13 user nova-compute[75342]:     </serial>
Nov 16 18:10:13 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:10:13 user nova-compute[75342]:     <video>
Nov 16 18:10:13 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:10:13 user nova-compute[75342]:     </video>
Nov 16 18:10:13 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:10:13 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:10:13 user nova-compute[75342]:     </rng>
Nov 16 18:10:13 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:10:13 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:10:13 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:10:13 user nova-compute[75342]:     </memballoon>
Nov 16 18:10:13 user nova-compute[75342]:   </devices>
Nov 16 18:10:13 user nova-compute[75342]: </domain>
Nov 16 18:10:13 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1011058480',display_name='tempest-TestShelveInstance-server-1011058480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1011058480',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiiI+Kbr7I++Ar7wZEVjMsGCaGZwXXvpVLemr4oPu6KcP5xOWW79PL8S3X7CGkmsoOgFJC/vOfwrrHTdTdEv1aDgavC1XoGmY0sba3f9D0T3rFUcp79le5MDwQtusWxOQ==',key_name='tempest-TestShelveInstance-2005458468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf819660602345c6acdb1caeff5bf347',ramdisk_id='',reservation_id='r-tij2s1qg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2088508252',owner_user_name='tempest-TestShelveInstance-2088508252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:10:06Z,user_data=None,user_id='ba8b928d71ce4f918f0d5d6bd78b0ebb',uuid=d4c63c32-8406-4498-b4de-8e8ecbc2a173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converting VIF {"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG os_vif [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa8a868d-8518-5af5-abf0-fa9d5d9c7d97', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f0e212f-0c, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f0e212f-0c, col_values=(('qos', UUID('e86cb71e-ed90-4cab-9903-4c44afacdcfd')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f0e212f-0c, col_values=(('external_ids', {'iface-id': '1f0e212f-0cb1-47be-b27f-90feb2b3568f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:5e:82', 'vm-uuid': 'd4c63c32-8406-4498-b4de-8e8ecbc2a173'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:10:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:13 user nova-compute[75342]: INFO os_vif [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c')
Nov 16 18:10:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:10:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] No VIF found with MAC fa:16:3e:88:5e:82, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:10:14 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Snapshot image upload complete
Nov 16 18:10:14 user nova-compute[75342]: INFO nova.compute.manager [None req-78bacccc-c2da-4290-9904-1d69eeef5adc tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Took 5.24 seconds to snapshot the instance on the hypervisor.
Nov 16 18:10:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-9b610d10-e0f6-4ad4-9851-ab26d2098f0f req-f2e20de6-0d62-4917-ae22-df1f0a97b776 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9b610d10-e0f6-4ad4-9851-ab26d2098f0f req-f2e20de6-0d62-4917-ae22-df1f0a97b776 service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9b610d10-e0f6-4ad4-9851-ab26d2098f0f req-f2e20de6-0d62-4917-ae22-df1f0a97b776 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9b610d10-e0f6-4ad4-9851-ab26d2098f0f req-f2e20de6-0d62-4917-ae22-df1f0a97b776 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-9b610d10-e0f6-4ad4-9851-ab26d2098f0f req-f2e20de6-0d62-4917-ae22-df1f0a97b776 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:10:15 user nova-compute[75342]: WARNING nova.compute.manager [req-9b610d10-e0f6-4ad4-9851-ab26d2098f0f req-f2e20de6-0d62-4917-ae22-df1f0a97b776 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state building and task_state spawning.
Nov 16 18:10:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:10:17 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Instance spawned successfully.
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:10:17 user nova-compute[75342]: INFO nova.compute.manager [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:10:17 user nova-compute[75342]: INFO nova.compute.manager [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Took 11.96 seconds to build instance.
Nov 16 18:10:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bf2bdff2-9360-4ec2-af3a-16c1da397e1c tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.075s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-a9055dc6-7be8-48a6-b02d-e8bf8e6d7762 req-d4d87a41-6999-4eb0-a96c-89ef0c4a413d service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9055dc6-7be8-48a6-b02d-e8bf8e6d7762 req-d4d87a41-6999-4eb0-a96c-89ef0c4a413d service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9055dc6-7be8-48a6-b02d-e8bf8e6d7762 req-d4d87a41-6999-4eb0-a96c-89ef0c4a413d service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a9055dc6-7be8-48a6-b02d-e8bf8e6d7762 req-d4d87a41-6999-4eb0-a96c-89ef0c4a413d service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-a9055dc6-7be8-48a6-b02d-e8bf8e6d7762 req-d4d87a41-6999-4eb0-a96c-89ef0c4a413d service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:10:17 user nova-compute[75342]: WARNING nova.compute.manager [req-a9055dc6-7be8-48a6-b02d-e8bf8e6d7762 req-d4d87a41-6999-4eb0-a96c-89ef0c4a413d service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state active and task_state None.
Nov 16 18:10:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:31 user nova-compute[75342]: INFO nova.compute.manager [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Terminating instance
Nov 16 18:10:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:10:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-fb53806f-f1b5-406c-b443-bebb9a87ed3d req-9db50d8c-e9f4-40c9-9e30-f4aa1d0e9864 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-vif-unplugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fb53806f-f1b5-406c-b443-bebb9a87ed3d req-9db50d8c-e9f4-40c9-9e30-f4aa1d0e9864 service nova] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fb53806f-f1b5-406c-b443-bebb9a87ed3d req-9db50d8c-e9f4-40c9-9e30-f4aa1d0e9864 service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fb53806f-f1b5-406c-b443-bebb9a87ed3d req-9db50d8c-e9f4-40c9-9e30-f4aa1d0e9864 service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-fb53806f-f1b5-406c-b443-bebb9a87ed3d req-9db50d8c-e9f4-40c9-9e30-f4aa1d0e9864 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] No waiting events found dispatching network-vif-unplugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-fb53806f-f1b5-406c-b443-bebb9a87ed3d req-9db50d8c-e9f4-40c9-9e30-f4aa1d0e9864 service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-vif-unplugged-70d27952-7221-44f5-b6fb-24d3416b1b2e for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:32 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Instance destroyed successfully.
Nov 16 18:10:32 user nova-compute[75342]: DEBUG nova.objects.instance [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'resources' on Instance uuid fb00d09d-d7c3-43f8-a118-26868011460b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-539067305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-539067305',id=19,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQOSo7uIdt9k/PLg6VsDFmL+PRo3dwsxAbcVSW3Wj40XjIJQYbNLBtz/3H+zlgRaTYbZ1HgboxKf6Gyi0Z2bFK+BAiKEPzbjUjlAGPu0n8gqG1SnPKxOjVIlr4Yh7ayVQ==',key_name='tempest-keypair-279505456',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:08:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-4tz76pmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=fb00d09d-d7c3-43f8-a118-26868011460b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "address": "fa:16:3e:c5:bd:3a", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d27952-72", "ovs_interfaceid": "70d27952-7221-44f5-b6fb-24d3416b1b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG os_vif [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70d27952-72, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5001c3c-e7a6-47ef-8ef9-ec3facc6aacb) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:32 user nova-compute[75342]: INFO os_vif [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bd:3a,bridge_name='br-int',has_traffic_filtering=True,id=70d27952-7221-44f5-b6fb-24d3416b1b2e,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d27952-72')
Nov 16 18:10:32 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Deleting instance files /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b_del
Nov 16 18:10:32 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Deletion of /opt/stack/data/nova/instances/fb00d09d-d7c3-43f8-a118-26868011460b_del complete
Nov 16 18:10:32 user nova-compute[75342]: INFO nova.compute.manager [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 16 18:10:32 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:10:32 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:10:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:33 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:10:33 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Took 0.79 seconds to deallocate network for instance.
Nov 16 18:10:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-fd912844-9191-4bd1-b870-a8851b8576b5 req-cd8fa6f9-a138-4b64-99d5-b932a626d5ff service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-vif-deleted-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:33 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:10:33 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:10:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:34 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Deleted allocations for instance fb00d09d-d7c3-43f8-a118-26868011460b
Nov 16 18:10:34 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:34 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 18:10:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-dc08a749-cb35-465d-8b9b-a4e1486d70d6 req-07da65b3-ff5a-4ad1-8c9c-0fd3c9766ecb service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dc08a749-cb35-465d-8b9b-a4e1486d70d6 req-07da65b3-ff5a-4ad1-8c9c-0fd3c9766ecb service nova] Acquiring lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dc08a749-cb35-465d-8b9b-a4e1486d70d6 req-07da65b3-ff5a-4ad1-8c9c-0fd3c9766ecb service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dc08a749-cb35-465d-8b9b-a4e1486d70d6 req-07da65b3-ff5a-4ad1-8c9c-0fd3c9766ecb service nova] Lock "fb00d09d-d7c3-43f8-a118-26868011460b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-dc08a749-cb35-465d-8b9b-a4e1486d70d6 req-07da65b3-ff5a-4ad1-8c9c-0fd3c9766ecb service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] No waiting events found dispatching network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:10:34 user nova-compute[75342]: WARNING nova.compute.manager [req-dc08a749-cb35-465d-8b9b-a4e1486d70d6 req-07da65b3-ff5a-4ad1-8c9c-0fd3c9766ecb service nova] [instance: fb00d09d-d7c3-43f8-a118-26868011460b] Received unexpected event network-vif-plugged-70d27952-7221-44f5-b6fb-24d3416b1b2e for instance with vm_state deleted and task_state None.
Nov 16 18:10:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66ac4aae-ef9e-4248-866e-05db25d9753a tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "fb00d09d-d7c3-43f8-a118-26868011460b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.488s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:37 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:37 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:10:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:39 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:39 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:40 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:40 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:40 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 18:10:40 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] There are 0 instances to clean {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 18:10:40 user nova-compute[75342]: DEBUG nova.objects.instance [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquired lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.network.neutron [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.objects.instance [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'info_cache' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.objects.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.network.neutron [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Updating instance_info_cache with network_info: [{"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Releasing lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:10:41 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance destroyed successfully.
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.objects.instance [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'resources' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.objects.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2074580807',display_name='tempest-AttachVolumeTestJSON-server-2074580807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2074580807',id=25,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPFfdYGYtdfUwjEiOE/iwsDZ8HxFnxrUjMrOXe3mcWU8NAzXmZ0SHoyGfYP5VBo3S4o53/E3MwQVBkBzuKmzbRAXUrMsihBETp/TApLvk6647LfkR70K66wWqQJP/b4A==',key_name='tempest-keypair-1267583389',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-pms15lgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=361ee32d-4ad3-4bd3-bdf9-6fd404d0f297,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_vif [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap326f6a9c-15, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6399619a-a3a0-4c5b-b887-2ba130d546a0) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:10:41 user nova-compute[75342]: INFO os_vif [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15')
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVMmveyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:10:41 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3074939-5a3d-4e4f-83f2-7cbedb9fe4f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:10:41 user nova-compute[75342]: No targets found.
Nov 16 18:10:41 user nova-compute[75342]: iSNS:
Nov 16 18:10:41 user nova-compute[75342]: No targets found.
Nov 16 18:10:41 user nova-compute[75342]: STATIC:
Nov 16 18:10:41 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e
Nov 16 18:10:41 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:10:41 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:10:41 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519
Nov 16 18:10:41 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:10:41 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:10:41 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:10:41 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:10:41 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:10:41 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1
Nov 16 18:10:41 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:10:41 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:10:41 user nova-compute[75342]: FIRMWARE:
Nov 16 18:10:41 user nova-compute[75342]: No targets found.
Nov 16 18:10:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:10:41 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:10:41 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2536e7f1-aeb1-4b6a-8a15-23c39c6b4b37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8ed457-5084-4c49-8763-1392117098c3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:41 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:10:41 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:41 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:10:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:41 user nova-compute[75342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:10:41 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:41 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:10:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6d0160dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65e72fd-a7f2-4c4d-89b5-c7ee6766e7b0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[93458f94-c8d2-49ff-acfb-d678bc6e1f27]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b77934b-9609-44c3-b9fe-e3edac3c3e72]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5883a5a-b3b5-41cc-9eaa-509e714d9554]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e0516f-12e3-4381-a371-6a548b8d8228]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe2e363-ee59-421c-8ac4-5762d0952209]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260]
Nov 16 18:10:41 user nova-compute[75342]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260] successful.
Nov 16 18:10:41 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d945999a-021e-43ad-b7a2-913d4b09542b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] <== disconnect_volume: return (320ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Start _get_guest_xml network_info=[{"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6f072cd4-890f-40fd-90bf-e2bd9bfec4be', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVMmveyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '361ee32d-4ad3-4bd3-bdf9-6fd404d0f297', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed80d9c2-3208-4679-8fd7-b350b2ab807e', 'serial': 'ed80d9c2-3208-4679-8fd7-b350b2ab807e'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.objects.instance [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'numa_topology' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.objects.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:10:41 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:10:41 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.objects.instance [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'vcpu_model' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.objects.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVMmveyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:10:41 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:10:41 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:10:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:10:41 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:10:41 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70370dd-7348-4111-8e2a-ec09c42c1ee1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:10:42 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0168c5d-ba34-4c29-8240-0db3ee3b0202]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e] added
Nov 16 18:10:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[abee0092-e251-43ac-ba40-aa8157a08d5d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125ce73-982b-4bfd-b95e-dbed36c051f9]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IVMmveyF {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IVMmveyF" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cec3b8-99ec-4915-8619-ff2cf4a4e7f0]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IVMmveyF'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5959f1-c82a-449d-996a-cf3918b98a16]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a2355e-6bb4-409d-8bce-64b8c7f2264b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5631ec42-0ad3-4e27-846f-35ab24fe9dc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260]
Nov 16 18:10:42 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260] successful.
Nov 16 18:10:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8b52b7-ba32-4409-b259-c1e5ecd69860]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[72adbb7b-d720-4a85-b72e-0a688fd247dc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:10:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:10:42 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:10:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9932241a-4116-4e68-a54b-5eb3f3c58e21]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVMmveyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:10:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26237303736303332', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237303736303332', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2074580807',display_name='tempest-AttachVolumeTestJSON-server-2074580807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2074580807',id=25,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPFfdYGYtdfUwjEiOE/iwsDZ8HxFnxrUjMrOXe3mcWU8NAzXmZ0SHoyGfYP5VBo3S4o53/E3MwQVBkBzuKmzbRAXUrMsihBETp/TApLvk6647LfkR70K66wWqQJP/b4A==',key_name='tempest-keypair-1267583389',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-pms15lgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=361ee32d-4ad3-4bd3-bdf9-6fd404d0f297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.objects.instance [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'pci_devices' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.objects.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:10:43 user nova-compute[75342]:   <uuid>361ee32d-4ad3-4bd3-bdf9-6fd404d0f297</uuid>
Nov 16 18:10:43 user nova-compute[75342]:   <name>instance-00000019</name>
Nov 16 18:10:43 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:10:43 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:10:43 user nova-compute[75342]:   <metadata>
Nov 16 18:10:43 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:10:43 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:10:43 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeTestJSON-server-2074580807</nova:name>
Nov 16 18:10:43 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:10:41</nova:creationTime>
Nov 16 18:10:43 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:10:43 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:10:43 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:10:43 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:10:43 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:10:43 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:10:43 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:10:43 user nova-compute[75342]:       <nova:owner>
Nov 16 18:10:43 user nova-compute[75342]:         <nova:user uuid="1da0d585d0e04be284e3eb50ce093d89">tempest-AttachVolumeTestJSON-410390487-project-member</nova:user>
Nov 16 18:10:43 user nova-compute[75342]:         <nova:project uuid="6b7dafce5e534279b01a17644c620e36">tempest-AttachVolumeTestJSON-410390487</nova:project>
Nov 16 18:10:43 user nova-compute[75342]:       </nova:owner>
Nov 16 18:10:43 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:10:43 user nova-compute[75342]:       <nova:ports>
Nov 16 18:10:43 user nova-compute[75342]:         <nova:port uuid="326f6a9c-1559-4846-b2df-cb6b8ac9eed9">
Nov 16 18:10:43 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 18:10:43 user nova-compute[75342]:         </nova:port>
Nov 16 18:10:43 user nova-compute[75342]:       </nova:ports>
Nov 16 18:10:43 user nova-compute[75342]:     </nova:instance>
Nov 16 18:10:43 user nova-compute[75342]:   </metadata>
Nov 16 18:10:43 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:10:43 user nova-compute[75342]:     <system>
Nov 16 18:10:43 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:10:43 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:10:43 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:10:43 user nova-compute[75342]:       <entry name="serial">361ee32d-4ad3-4bd3-bdf9-6fd404d0f297</entry>
Nov 16 18:10:43 user nova-compute[75342]:       <entry name="uuid">361ee32d-4ad3-4bd3-bdf9-6fd404d0f297</entry>
Nov 16 18:10:43 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:10:43 user nova-compute[75342]:     </system>
Nov 16 18:10:43 user nova-compute[75342]:   </sysinfo>
Nov 16 18:10:43 user nova-compute[75342]:   <os>
Nov 16 18:10:43 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:10:43 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:10:43 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:10:43 user nova-compute[75342]:   </os>
Nov 16 18:10:43 user nova-compute[75342]:   <features>
Nov 16 18:10:43 user nova-compute[75342]:     <acpi/>
Nov 16 18:10:43 user nova-compute[75342]:     <apic/>
Nov 16 18:10:43 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:10:43 user nova-compute[75342]:   </features>
Nov 16 18:10:43 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:10:43 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:10:43 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:10:43 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:10:43 user nova-compute[75342]:   </clock>
Nov 16 18:10:43 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:10:43 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:10:43 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:10:43 user nova-compute[75342]:   </cpu>
Nov 16 18:10:43 user nova-compute[75342]:   <devices>
Nov 16 18:10:43 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:10:43 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:10:43 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk"/>
Nov 16 18:10:43 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:10:43 user nova-compute[75342]:     </disk>
Nov 16 18:10:43 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:10:43 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:10:43 user nova-compute[75342]:       <source dev="/dev/sdb"/>
Nov 16 18:10:43 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:10:43 user nova-compute[75342]:       <serial>ed80d9c2-3208-4679-8fd7-b350b2ab807e</serial>
Nov 16 18:10:43 user nova-compute[75342]:     </disk>
Nov 16 18:10:43 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:10:43 user nova-compute[75342]:       <mac address="fa:16:3e:3f:c1:5a"/>
Nov 16 18:10:43 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:10:43 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:10:43 user nova-compute[75342]:       <target dev="tap326f6a9c-15"/>
Nov 16 18:10:43 user nova-compute[75342]:     </interface>
Nov 16 18:10:43 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:10:43 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/console.log" append="off"/>
Nov 16 18:10:43 user nova-compute[75342]:     </serial>
Nov 16 18:10:43 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:10:43 user nova-compute[75342]:     <video>
Nov 16 18:10:43 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:10:43 user nova-compute[75342]:     </video>
Nov 16 18:10:43 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:10:43 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:10:43 user nova-compute[75342]:     </rng>
Nov 16 18:10:43 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:10:43 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:10:43 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:10:43 user nova-compute[75342]:     </memballoon>
Nov 16 18:10:43 user nova-compute[75342]:   </devices>
Nov 16 18:10:43 user nova-compute[75342]: </domain>
Nov 16 18:10:43 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.objects.instance [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'trusted_certs' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.objects.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:10:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Cannot resize image /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG nova.objects.instance [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'migration_context' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG nova.objects.base [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2074580807',display_name='tempest-AttachVolumeTestJSON-server-2074580807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2074580807',id=25,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPFfdYGYtdfUwjEiOE/iwsDZ8HxFnxrUjMrOXe3mcWU8NAzXmZ0SHoyGfYP5VBo3S4o53/E3MwQVBkBzuKmzbRAXUrMsihBETp/TApLvk6647LfkR70K66wWqQJP/b4A==',key_name='tempest-keypair-1267583389',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-pms15lgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=361ee32d-4ad3-4bd3-bdf9-6fd404d0f297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG os_vif [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43d5eb76-b0c2-5a18-acfb-a6d02ddba571', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap326f6a9c-15, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap326f6a9c-15, col_values=(('qos', UUID('9d85fe2b-238b-4099-8cfd-a6dbf1a58bad')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap326f6a9c-15, col_values=(('external_ids', {'iface-id': '326f6a9c-1559-4846-b2df-cb6b8ac9eed9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:c1:5a', 'vm-uuid': '361ee32d-4ad3-4bd3-bdf9-6fd404d0f297'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:44 user nova-compute[75342]: INFO os_vif [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15')
Nov 16 18:10:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:10:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-7aa4a8e8-438a-4a8a-8392-62a36a9f6966 req-5470c076-1c60-402e-949f-9f0b7fa2ad74 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7aa4a8e8-438a-4a8a-8392-62a36a9f6966 req-5470c076-1c60-402e-949f-9f0b7fa2ad74 service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7aa4a8e8-438a-4a8a-8392-62a36a9f6966 req-5470c076-1c60-402e-949f-9f0b7fa2ad74 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7aa4a8e8-438a-4a8a-8392-62a36a9f6966 req-5470c076-1c60-402e-949f-9f0b7fa2ad74 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-7aa4a8e8-438a-4a8a-8392-62a36a9f6966 req-5470c076-1c60-402e-949f-9f0b7fa2ad74 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:10:48 user nova-compute[75342]: WARNING nova.compute.manager [req-7aa4a8e8-438a-4a8a-8392-62a36a9f6966 req-5470c076-1c60-402e-949f-9f0b7fa2ad74 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received unexpected event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with vm_state stopped and task_state powering-on.
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-9cf1f692-f3c9-4c38-ad63-08986a7fac75 req-72ae5c7f-3da0-4761-8a6f-d870b58d7fb2 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9cf1f692-f3c9-4c38-ad63-08986a7fac75 req-72ae5c7f-3da0-4761-8a6f-d870b58d7fb2 service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9cf1f692-f3c9-4c38-ad63-08986a7fac75 req-72ae5c7f-3da0-4761-8a6f-d870b58d7fb2 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9cf1f692-f3c9-4c38-ad63-08986a7fac75 req-72ae5c7f-3da0-4761-8a6f-d870b58d7fb2 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-9cf1f692-f3c9-4c38-ad63-08986a7fac75 req-72ae5c7f-3da0-4761-8a6f-d870b58d7fb2 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:10:48 user nova-compute[75342]: WARNING nova.compute.manager [req-9cf1f692-f3c9-4c38-ad63-08986a7fac75 req-72ae5c7f-3da0-4761-8a6f-d870b58d7fb2 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received unexpected event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with vm_state stopped and task_state powering-on.
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:10:48 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:10:48 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7541MB free_disk=25.187744140625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:48 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance rebooted successfully.
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-45781fa3-b27c-4960-9c15-d20e2fe9ab01 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c6408c85-ed86-4b11-afa6-14f93b92492c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 120e116f-a0e5-406c-9883-6f173da89100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 645e4341-403d-461d-9111-a8046ae4feb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 1ce7aa5b-319e-4167-afc8-bcacd55fd794 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d4c63c32-8406-4498-b4de-8e8ecbc2a173 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing inventories for resource provider fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating ProviderTree inventory for provider fdd6b940-75a0-4315-8416-79157aaeea59 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing aggregate associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, aggregates: None {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing trait associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, traits: COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.781s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:48 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:10:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:10:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:10:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:10:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Updating instance_info_cache with network_info: [{"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:10:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:10:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:10:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:10:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "645e4341-403d-461d-9111-a8046ae4feb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "645e4341-403d-461d-9111-a8046ae4feb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "645e4341-403d-461d-9111-a8046ae4feb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "645e4341-403d-461d-9111-a8046ae4feb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "645e4341-403d-461d-9111-a8046ae4feb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:51 user nova-compute[75342]: INFO nova.compute.manager [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Terminating instance
Nov 16 18:10:52 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-b597e58c-bdbd-4f3d-a0fd-fda2a6bc0761 req-56cc1573-5936-40ae-9bcc-c08d5375d6ed service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Received event network-vif-unplugged-e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b597e58c-bdbd-4f3d-a0fd-fda2a6bc0761 req-56cc1573-5936-40ae-9bcc-c08d5375d6ed service nova] Acquiring lock "645e4341-403d-461d-9111-a8046ae4feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b597e58c-bdbd-4f3d-a0fd-fda2a6bc0761 req-56cc1573-5936-40ae-9bcc-c08d5375d6ed service nova] Lock "645e4341-403d-461d-9111-a8046ae4feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b597e58c-bdbd-4f3d-a0fd-fda2a6bc0761 req-56cc1573-5936-40ae-9bcc-c08d5375d6ed service nova] Lock "645e4341-403d-461d-9111-a8046ae4feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-b597e58c-bdbd-4f3d-a0fd-fda2a6bc0761 req-56cc1573-5936-40ae-9bcc-c08d5375d6ed service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] No waiting events found dispatching network-vif-unplugged-e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-b597e58c-bdbd-4f3d-a0fd-fda2a6bc0761 req-56cc1573-5936-40ae-9bcc-c08d5375d6ed service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Received event network-vif-unplugged-e053a2ca-777d-43d7-b791-3978c489ef2e for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:10:52 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Instance destroyed successfully.
Nov 16 18:10:52 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lazy-loading 'resources' on Instance uuid 645e4341-403d-461d-9111-a8046ae4feb8 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:09:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-722824667',display_name='tempest-VolumesActionsTest-instance-722824667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-722824667',id=27,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:09:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab9d3323184440bfa3a59fe001304b3b',ramdisk_id='',reservation_id='r-yk9u0wq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1486004135',owner_user_name='tempest-VolumesActionsTest-1486004135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:09:07Z,user_data=None,user_id='fd02be1850ee43f8943d236ed1093864',uuid=645e4341-403d-461d-9111-a8046ae4feb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e053a2ca-777d-43d7-b791-3978c489ef2e", "address": "fa:16:3e:ad:91:f0", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape053a2ca-77", "ovs_interfaceid": "e053a2ca-777d-43d7-b791-3978c489ef2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converting VIF {"id": "e053a2ca-777d-43d7-b791-3978c489ef2e", "address": "fa:16:3e:ad:91:f0", "network": {"id": "e8a78b6c-951d-4cfd-8c8f-43a187440459", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1403796084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9d3323184440bfa3a59fe001304b3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape053a2ca-77", "ovs_interfaceid": "e053a2ca-777d-43d7-b791-3978c489ef2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:91:f0,bridge_name='br-int',has_traffic_filtering=True,id=e053a2ca-777d-43d7-b791-3978c489ef2e,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape053a2ca-77') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG os_vif [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:91:f0,bridge_name='br-int',has_traffic_filtering=True,id=e053a2ca-777d-43d7-b791-3978c489ef2e,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape053a2ca-77') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape053a2ca-77, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b7f6eb7-04a7-4355-8154-8651da80a95a) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:10:52 user nova-compute[75342]: INFO os_vif [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:91:f0,bridge_name='br-int',has_traffic_filtering=True,id=e053a2ca-777d-43d7-b791-3978c489ef2e,network=Network(e8a78b6c-951d-4cfd-8c8f-43a187440459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape053a2ca-77')
Nov 16 18:10:52 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Deleting instance files /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8_del
Nov 16 18:10:52 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Deletion of /opt/stack/data/nova/instances/645e4341-403d-461d-9111-a8046ae4feb8_del complete
Nov 16 18:10:52 user nova-compute[75342]: INFO nova.compute.manager [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 16 18:10:52 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:10:52 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:10:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:53 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:10:53 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Took 0.47 seconds to deallocate network for instance.
Nov 16 18:10:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:53 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:10:53 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:10:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:53 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Deleted allocations for instance 645e4341-403d-461d-9111-a8046ae4feb8
Nov 16 18:10:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8122fa55-b39a-44b4-9db0-8148222ec33c tempest-VolumesActionsTest-1486004135 tempest-VolumesActionsTest-1486004135-project-member] Lock "645e4341-403d-461d-9111-a8046ae4feb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-3adbcf3f-8e95-42a8-a6d2-706127844feb req-644f5789-63a6-48ab-839c-f578c1409035 service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Received event network-vif-plugged-e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3adbcf3f-8e95-42a8-a6d2-706127844feb req-644f5789-63a6-48ab-839c-f578c1409035 service nova] Acquiring lock "645e4341-403d-461d-9111-a8046ae4feb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:10:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3adbcf3f-8e95-42a8-a6d2-706127844feb req-644f5789-63a6-48ab-839c-f578c1409035 service nova] Lock "645e4341-403d-461d-9111-a8046ae4feb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:10:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3adbcf3f-8e95-42a8-a6d2-706127844feb req-644f5789-63a6-48ab-839c-f578c1409035 service nova] Lock "645e4341-403d-461d-9111-a8046ae4feb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:10:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-3adbcf3f-8e95-42a8-a6d2-706127844feb req-644f5789-63a6-48ab-839c-f578c1409035 service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] No waiting events found dispatching network-vif-plugged-e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:10:54 user nova-compute[75342]: WARNING nova.compute.manager [req-3adbcf3f-8e95-42a8-a6d2-706127844feb req-644f5789-63a6-48ab-839c-f578c1409035 service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Received unexpected event network-vif-plugged-e053a2ca-777d-43d7-b791-3978c489ef2e for instance with vm_state deleted and task_state None.
Nov 16 18:10:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-3adbcf3f-8e95-42a8-a6d2-706127844feb req-644f5789-63a6-48ab-839c-f578c1409035 service nova] [instance: 645e4341-403d-461d-9111-a8046ae4feb8] Received event network-vif-deleted-e053a2ca-777d-43d7-b791-3978c489ef2e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-6f6db239-26ce-4fbd-866e-c517ab7bec5a req-d948ccca-e1bd-4571-9389-b9e9cba19a68 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Received event network-changed-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:10:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-6f6db239-26ce-4fbd-866e-c517ab7bec5a req-d948ccca-e1bd-4571-9389-b9e9cba19a68 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Refreshing instance network info cache due to event network-changed-4e36c11c-a2ec-4447-bfcc-c120ceaa8338. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:10:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6f6db239-26ce-4fbd-866e-c517ab7bec5a req-d948ccca-e1bd-4571-9389-b9e9cba19a68 service nova] Acquiring lock "refresh_cache-1ce7aa5b-319e-4167-afc8-bcacd55fd794" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:10:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6f6db239-26ce-4fbd-866e-c517ab7bec5a req-d948ccca-e1bd-4571-9389-b9e9cba19a68 service nova] Acquired lock "refresh_cache-1ce7aa5b-319e-4167-afc8-bcacd55fd794" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:10:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-6f6db239-26ce-4fbd-866e-c517ab7bec5a req-d948ccca-e1bd-4571-9389-b9e9cba19a68 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Refreshing network info cache for port 4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:10:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-6f6db239-26ce-4fbd-866e-c517ab7bec5a req-d948ccca-e1bd-4571-9389-b9e9cba19a68 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Updated VIF entry in instance network info cache for port 4e36c11c-a2ec-4447-bfcc-c120ceaa8338. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:10:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-6f6db239-26ce-4fbd-866e-c517ab7bec5a req-d948ccca-e1bd-4571-9389-b9e9cba19a68 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Updating instance_info_cache with network_info: [{"id": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "address": "fa:16:3e:0a:cd:6c", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e36c11c-a2", "ovs_interfaceid": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:10:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6f6db239-26ce-4fbd-866e-c517ab7bec5a req-d948ccca-e1bd-4571-9389-b9e9cba19a68 service nova] Releasing lock "refresh_cache-1ce7aa5b-319e-4167-afc8-bcacd55fd794" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:10:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:10:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "6a4d9392-83e5-4423-90ce-18283717f5df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "6a4d9392-83e5-4423-90ce-18283717f5df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:11:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:11:02 user nova-compute[75342]: INFO nova.compute.claims [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Claim successful on node user
Nov 16 18:11:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:03 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:11:03 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:11:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:11:03 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:11:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:11:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:11:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:11:03 user nova-compute[75342]: INFO nova.virt.block_device [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Booting with volume snapshot 2f6cb6a2-8346-46b7-ac34-03f09e8f687a at /dev/vda
Nov 16 18:11:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:03 user nova-compute[75342]: DEBUG nova.policy [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '062cd6d338014493be6c40701d2a735b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d44dce2b444ef386b47927d5c70c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:11:04 user nova-compute[75342]: DEBUG nova.network.neutron [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Successfully created port: 7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Successfully updated port: 7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "refresh_cache-6a4d9392-83e5-4423-90ce-18283717f5df" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquired lock "refresh_cache-6a4d9392-83e5-4423-90ce-18283717f5df" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-8f5cfbdc-2137-4b3f-ae32-93e07a19f4e6 req-2bffc1ec-c420-4ad3-827c-a07efe0db984 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Received event network-changed-7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-8f5cfbdc-2137-4b3f-ae32-93e07a19f4e6 req-2bffc1ec-c420-4ad3-827c-a07efe0db984 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Refreshing instance network info cache due to event network-changed-7803709a-5b87-4615-8acd-771c12899de8. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8f5cfbdc-2137-4b3f-ae32-93e07a19f4e6 req-2bffc1ec-c420-4ad3-827c-a07efe0db984 service nova] Acquiring lock "refresh_cache-6a4d9392-83e5-4423-90ce-18283717f5df" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Updating instance_info_cache with network_info: [{"id": "7803709a-5b87-4615-8acd-771c12899de8", "address": "fa:16:3e:c6:d1:d9", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7803709a-5b", "ovs_interfaceid": "7803709a-5b87-4615-8acd-771c12899de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Releasing lock "refresh_cache-6a4d9392-83e5-4423-90ce-18283717f5df" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Instance network_info: |[{"id": "7803709a-5b87-4615-8acd-771c12899de8", "address": "fa:16:3e:c6:d1:d9", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7803709a-5b", "ovs_interfaceid": "7803709a-5b87-4615-8acd-771c12899de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8f5cfbdc-2137-4b3f-ae32-93e07a19f4e6 req-2bffc1ec-c420-4ad3-827c-a07efe0db984 service nova] Acquired lock "refresh_cache-6a4d9392-83e5-4423-90ce-18283717f5df" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG nova.network.neutron [req-8f5cfbdc-2137-4b3f-ae32-93e07a19f4e6 req-2bffc1ec-c420-4ad3-827c-a07efe0db984 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Refreshing network info cache for port 7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG nova.network.neutron [req-8f5cfbdc-2137-4b3f-ae32-93e07a19f4e6 req-2bffc1ec-c420-4ad3-827c-a07efe0db984 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Updated VIF entry in instance network info cache for port 7803709a-5b87-4615-8acd-771c12899de8. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG nova.network.neutron [req-8f5cfbdc-2137-4b3f-ae32-93e07a19f4e6 req-2bffc1ec-c420-4ad3-827c-a07efe0db984 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Updating instance_info_cache with network_info: [{"id": "7803709a-5b87-4615-8acd-771c12899de8", "address": "fa:16:3e:c6:d1:d9", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7803709a-5b", "ovs_interfaceid": "7803709a-5b87-4615-8acd-771c12899de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8f5cfbdc-2137-4b3f-ae32-93e07a19f4e6 req-2bffc1ec-c420-4ad3-827c-a07efe0db984 service nova] Releasing lock "refresh_cache-6a4d9392-83e5-4423-90ce-18283717f5df" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:11:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:08 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:11:08 user nova-compute[75342]: INFO nova.compute.claims [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Claim successful on node user
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.utils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[64445b7e-0aa3-4219-bb21-a9f5d619322d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78272f2-29a0-4df6-9c6e-726915b368a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[698e11b8-1ba9-455d-9a32-7a9503ab23c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c2aecc-3b04-4c25-8ffc-374f31e6646c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:11:09 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9481750-5697-4739-a891-ea2068b5725d]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.utils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Updating existing volume attachment record: dd0beb24-5023-4ed5-b3f2-19c7a2a79bb4 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG nova.compute.manager [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG nova.compute.manager [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG nova.network.neutron [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:11:09 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:11:09 user nova-compute[75342]: DEBUG nova.compute.manager [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:11:09 user nova-compute[75342]: INFO nova.virt.block_device [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Booting with volume 62eb0bc9-da13-416b-ae9d-1bf9d700996c at /dev/vda
Nov 16 18:11:09 user nova-compute[75342]: DEBUG nova.policy [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1794b9bef4ad42e6aab088f3ef90dba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78cae892fff433eb216caff3a127a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.utils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a963bd8-8aa4-45df-a216-9b51685e0a3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43110df-55b1-4785-a51f-bc4a39fac886]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d886361-23df-4bd8-ba26-4ea8af8fe412]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc86663-6b3f-4524-b6ee-1ab6a500aab6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:11:09 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:11:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[43354229-e742-4fa1-88ea-8f0cf30f293e]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG os_brick.utils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:11:09 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updating existing volume attachment record: 18de6008-5132-45f0-a5de-83be6fbdda08 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:11:10 user nova-compute[75342]: DEBUG nova.network.neutron [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Successfully created port: b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG nova.network.neutron [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Successfully updated port: b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquired lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG nova.network.neutron [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-3fb1ba18-c5e2-4ce0-ad07-61c947e62b48 req-4011c217-0bd5-4e59-9f72-9dd9f2be4e13 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-changed-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-3fb1ba18-c5e2-4ce0-ad07-61c947e62b48 req-4011c217-0bd5-4e59-9f72-9dd9f2be4e13 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Refreshing instance network info cache due to event network-changed-b0832714-4459-45d7-bf7f-acb458b04551. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3fb1ba18-c5e2-4ce0-ad07-61c947e62b48 req-4011c217-0bd5-4e59-9f72-9dd9f2be4e13 service nova] Acquiring lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG nova.network.neutron [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG nova.network.neutron [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updating instance_info_cache with network_info: [{"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Releasing lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG nova.compute.manager [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Instance network_info: |[{"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3fb1ba18-c5e2-4ce0-ad07-61c947e62b48 req-4011c217-0bd5-4e59-9f72-9dd9f2be4e13 service nova] Acquired lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG nova.network.neutron [req-3fb1ba18-c5e2-4ce0-ad07-61c947e62b48 req-4011c217-0bd5-4e59-9f72-9dd9f2be4e13 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Refreshing network info cache for port b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG nova.network.neutron [req-3fb1ba18-c5e2-4ce0-ad07-61c947e62b48 req-4011c217-0bd5-4e59-9f72-9dd9f2be4e13 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updated VIF entry in instance network info cache for port b0832714-4459-45d7-bf7f-acb458b04551. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG nova.network.neutron [req-3fb1ba18-c5e2-4ce0-ad07-61c947e62b48 req-4011c217-0bd5-4e59-9f72-9dd9f2be4e13 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updating instance_info_cache with network_info: [{"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3fb1ba18-c5e2-4ce0-ad07-61c947e62b48 req-4011c217-0bd5-4e59-9f72-9dd9f2be4e13 service nova] Releasing lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:11:14 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Creating image(s)
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Ensure instance console log exists: /opt/stack/data/nova/instances/6a4d9392-83e5-4423-90ce-18283717f5df/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Start _get_guest_xml network_info=[{"id": "7803709a-5b87-4615-8acd-771c12899de8", "address": "fa:16:3e:c6:d1:d9", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7803709a-5b", "ovs_interfaceid": "7803709a-5b87-4615-8acd-771c12899de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T18:10:57Z,direct_url=<?>,disk_format='qcow2',id=2982d37e-6709-4c72-8318-4dc6c531f8ef,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1366307604',owner='46d44dce2b444ef386b47927d5c70c8e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T18:10:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'dd0beb24-5023-4ed5-b3f2-19c7a2a79bb4', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saLDGYnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a4d9392-83e5-4423-90ce-18283717f5df', 'attached_at': '', 'detached_at': '', 'volume_id': '8a629320-710b-47c3-bdcb-88754cc4c183', 'serial': '8a629320-710b-47c3-bdcb-88754cc4c183'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:11:14 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:14 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T18:10:57Z,direct_url=<?>,disk_format='qcow2',id=2982d37e-6709-4c72-8318-4dc6c531f8ef,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1366307604',owner='46d44dce2b444ef386b47927d5c70c8e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T18:10:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saLDGYnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:11:14 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:11:14 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:11:14 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e12dcdd-e066-49e3-a3e0-7eceb94b6ac5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:11:14 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0445a919-c146-41eb-974b-59fc915ddb21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183] added
Nov 16 18:11:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b69532-dcbe-49e6-9421-41c8009ae685]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a49ce21-74d9-447d-a77e-8da1cc9ff3cd]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saLDGYnW {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saLDGYnW" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3590507a-c1b2-4c09-a115-b2dda9e23ac6]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'saLDGYnW'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f34016-3c28-4f2d-9960-7023ef55ce81]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b06729-c4c2-44a6-b64e-726e66bca0f1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:14 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:14 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:14 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:14 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:14 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:14 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:14 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:11:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a4243b-390d-4feb-8844-489cc36daf58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183, portal: 172.16.0.220,3260]
Nov 16 18:11:15 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183, portal: 172.16.0.220,3260] successful.
Nov 16 18:11:15 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:11:15 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Creating image(s)
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Ensure instance console log exists: /opt/stack/data/nova/instances/147d9aee-cfd9-4e78-bf35-0ac7e16f6679/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Start _get_guest_xml network_info=[{"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '18de6008-5132-45f0-a5de-83be6fbdda08', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtrUQGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '147d9aee-cfd9-4e78-bf35-0ac7e16f6679', 'attached_at': '', 'detached_at': '', 'volume_id': '62eb0bc9-da13-416b-ae9d-1bf9d700996c', 'serial': '62eb0bc9-da13-416b-ae9d-1bf9d700996c'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3ed07c-0254-4f3c-b798-d11f95efe28f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:15 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:15 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtrUQGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:11:15 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ac84f4-91b9-4ade-bb8f-95aae6e5af4a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:15 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:15 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:15 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:15 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:11:15 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:15 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:15 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:15 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:15 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:11:15 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c070636b-9500-4803-88d4-1e79a029ccda]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:11:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saLDGYnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23938376134636537', 'path': '/dev/sdf'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938376134636537', 'path': '/dev/sdf'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.039s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:11:16 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:11:16 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b0b6e5-186c-4ea1-8571-98dd2f2f9455]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:11:16 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1712771091',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1712771091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1712771091',id=30,image_ref='2982d37e-6709-4c72-8318-4dc6c531f8ef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUd788Q6xCLXGQnFtwqMjzq++0DM4XV7RVnVqlsFekJn1zfNFxn1vi/8ijA8qoWHa3gxHYc0E8tpsDtolDeyFwq45C/+0aa+pBadU3c4ysGj6cqjKgQf6td52GwIJWJ8Q==',key_name='tempest-keypair-296278280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-t0o4gcpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-312873750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062cd6d338014493be6c40701d2a735b',uuid=6a4d9392-83e5-4423-90ce-18283717f5df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7803709a-5b87-4615-8acd-771c12899de8", "address": "fa:16:3e:c6:d1:d9", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7803709a-5b", "ovs_interfaceid": "7803709a-5b87-4615-8acd-771c12899de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "7803709a-5b87-4615-8acd-771c12899de8", "address": "fa:16:3e:c6:d1:d9", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7803709a-5b", "ovs_interfaceid": "7803709a-5b87-4615-8acd-771c12899de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d1:d9,bridge_name='br-int',has_traffic_filtering=True,id=7803709a-5b87-4615-8acd-771c12899de8,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7803709a-5b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG nova.objects.instance [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a4d9392-83e5-4423-90ce-18283717f5df {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:11:16 user nova-compute[75342]:   <uuid>6a4d9392-83e5-4423-90ce-18283717f5df</uuid>
Nov 16 18:11:16 user nova-compute[75342]:   <name>instance-0000001e</name>
Nov 16 18:11:16 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:11:16 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:11:16 user nova-compute[75342]:   <metadata>
Nov 16 18:11:16 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:11:16 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:11:16 user nova-compute[75342]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1712771091</nova:name>
Nov 16 18:11:16 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:11:14</nova:creationTime>
Nov 16 18:11:16 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:11:16 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:11:16 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:11:16 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:11:16 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:11:16 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:11:16 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:11:16 user nova-compute[75342]:       <nova:owner>
Nov 16 18:11:16 user nova-compute[75342]:         <nova:user uuid="062cd6d338014493be6c40701d2a735b">tempest-TestVolumeBootPattern-312873750-project-member</nova:user>
Nov 16 18:11:16 user nova-compute[75342]:         <nova:project uuid="46d44dce2b444ef386b47927d5c70c8e">tempest-TestVolumeBootPattern-312873750</nova:project>
Nov 16 18:11:16 user nova-compute[75342]:       </nova:owner>
Nov 16 18:11:16 user nova-compute[75342]:       <nova:root type="image" uuid="2982d37e-6709-4c72-8318-4dc6c531f8ef"/>
Nov 16 18:11:16 user nova-compute[75342]:       <nova:ports>
Nov 16 18:11:16 user nova-compute[75342]:         <nova:port uuid="7803709a-5b87-4615-8acd-771c12899de8">
Nov 16 18:11:16 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 18:11:16 user nova-compute[75342]:         </nova:port>
Nov 16 18:11:16 user nova-compute[75342]:       </nova:ports>
Nov 16 18:11:16 user nova-compute[75342]:     </nova:instance>
Nov 16 18:11:16 user nova-compute[75342]:   </metadata>
Nov 16 18:11:16 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:11:16 user nova-compute[75342]:     <system>
Nov 16 18:11:16 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:11:16 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:11:16 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:11:16 user nova-compute[75342]:       <entry name="serial">6a4d9392-83e5-4423-90ce-18283717f5df</entry>
Nov 16 18:11:16 user nova-compute[75342]:       <entry name="uuid">6a4d9392-83e5-4423-90ce-18283717f5df</entry>
Nov 16 18:11:16 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:11:16 user nova-compute[75342]:     </system>
Nov 16 18:11:16 user nova-compute[75342]:   </sysinfo>
Nov 16 18:11:16 user nova-compute[75342]:   <os>
Nov 16 18:11:16 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:11:16 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:11:16 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:11:16 user nova-compute[75342]:   </os>
Nov 16 18:11:16 user nova-compute[75342]:   <features>
Nov 16 18:11:16 user nova-compute[75342]:     <acpi/>
Nov 16 18:11:16 user nova-compute[75342]:     <apic/>
Nov 16 18:11:16 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:11:16 user nova-compute[75342]:   </features>
Nov 16 18:11:16 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:11:16 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:11:16 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:11:16 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:11:16 user nova-compute[75342]:   </clock>
Nov 16 18:11:16 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:11:16 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:11:16 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:11:16 user nova-compute[75342]:   </cpu>
Nov 16 18:11:16 user nova-compute[75342]:   <devices>
Nov 16 18:11:16 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:11:16 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:11:16 user nova-compute[75342]:       <source dev="/dev/sdf"/>
Nov 16 18:11:16 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:11:16 user nova-compute[75342]:       <serial>8a629320-710b-47c3-bdcb-88754cc4c183</serial>
Nov 16 18:11:16 user nova-compute[75342]:     </disk>
Nov 16 18:11:16 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:11:16 user nova-compute[75342]:       <mac address="fa:16:3e:c6:d1:d9"/>
Nov 16 18:11:16 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:11:16 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:11:16 user nova-compute[75342]:       <target dev="tap7803709a-5b"/>
Nov 16 18:11:16 user nova-compute[75342]:     </interface>
Nov 16 18:11:16 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:11:16 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/6a4d9392-83e5-4423-90ce-18283717f5df/console.log" append="off"/>
Nov 16 18:11:16 user nova-compute[75342]:     </serial>
Nov 16 18:11:16 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:11:16 user nova-compute[75342]:     <video>
Nov 16 18:11:16 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:11:16 user nova-compute[75342]:     </video>
Nov 16 18:11:16 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:11:16 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:11:16 user nova-compute[75342]:     </rng>
Nov 16 18:11:16 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:11:16 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:11:16 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:11:16 user nova-compute[75342]:     </memballoon>
Nov 16 18:11:16 user nova-compute[75342]:   </devices>
Nov 16 18:11:16 user nova-compute[75342]: </domain>
Nov 16 18:11:16 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1712771091',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1712771091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1712771091',id=30,image_ref='2982d37e-6709-4c72-8318-4dc6c531f8ef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUd788Q6xCLXGQnFtwqMjzq++0DM4XV7RVnVqlsFekJn1zfNFxn1vi/8ijA8qoWHa3gxHYc0E8tpsDtolDeyFwq45C/+0aa+pBadU3c4ysGj6cqjKgQf6td52GwIJWJ8Q==',key_name='tempest-keypair-296278280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-t0o4gcpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-312873750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062cd6d338014493be6c40701d2a735b',uuid=6a4d9392-83e5-4423-90ce-18283717f5df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7803709a-5b87-4615-8acd-771c12899de8", "address": "fa:16:3e:c6:d1:d9", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7803709a-5b", "ovs_interfaceid": "7803709a-5b87-4615-8acd-771c12899de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "7803709a-5b87-4615-8acd-771c12899de8", "address": "fa:16:3e:c6:d1:d9", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7803709a-5b", "ovs_interfaceid": "7803709a-5b87-4615-8acd-771c12899de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d1:d9,bridge_name='br-int',has_traffic_filtering=True,id=7803709a-5b87-4615-8acd-771c12899de8,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7803709a-5b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_vif [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d1:d9,bridge_name='br-int',has_traffic_filtering=True,id=7803709a-5b87-4615-8acd-771c12899de8,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7803709a-5b') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a358967a-c58b-4c2f-af08-061339551ded]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c] added
Nov 16 18:11:16 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06a5629f-6bae-5e4a-99b8-68c095c7d807', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7803709a-5b, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7803709a-5b, col_values=(('qos', UUID('8d4fcb19-f626-4a91-ab03-a2eb5b26c907')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7803709a-5b, col_values=(('external_ids', {'iface-id': '7803709a-5b87-4615-8acd-771c12899de8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:d1:d9', 'vm-uuid': '6a4d9392-83e5-4423-90ce-18283717f5df'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddc9deb-2146-4596-be60-707618f48235]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:16 user nova-compute[75342]: INFO os_vif [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d1:d9,bridge_name='br-int',has_traffic_filtering=True,id=7803709a-5b87-4615-8acd-771c12899de8,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7803709a-5b')
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f23f03b-504f-4465-89a7-3df2464dec1d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtrUQGuB {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtrUQGuB" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[997a7c52-26b3-4471-847d-5809be4b0455]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FtrUQGuB'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No VIF found with MAC fa:16:3e:c6:d1:d9, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ee845c-ed3b-46dc-a1d3-be52877be558]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce5d7b6-4a97-4a81-9cd3-5b02a5ebc1ca]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f94cbba-d83e-4bd8-ae34-5cf4773aacda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260]
Nov 16 18:11:16 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260] successful.
Nov 16 18:11:16 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[45da3171-abb6-4560-b899-46ff11233f0b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba07991b-9ef1-43e8-bcde-f4b3de6317a7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:11:16 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:11:16 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:11:16 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be2a15a-f47e-4fe5-81b5-1f867de61907]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:11:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtrUQGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== connect_volume: return (2451ms) {'type': 'block', 'scsi_wwn': '26165313433383564', 'path': '/dev/sdg'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165313433383564', 'path': '/dev/sdg'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1621983513',display_name='tempest-ServerActionsTestOtherA-server-1621983513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1621983513',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU1men7gMttl3YEQ2iX5okVvx4lpe2gNM2yccK4kETnd8Mrupb252faDCsR3+7xPoiSo7c4DSoVxYlsKd1dOtU+J4xVhSH7sXMEH8ib246uK8ZL45kAm/O/eMxS5d6eeQ==',key_name='tempest-keypair-357673672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-1dkp454h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=147d9aee-cfd9-4e78-bf35-0ac7e16f6679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.objects.instance [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'pci_devices' on Instance uuid 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:11:17 user nova-compute[75342]:   <uuid>147d9aee-cfd9-4e78-bf35-0ac7e16f6679</uuid>
Nov 16 18:11:17 user nova-compute[75342]:   <name>instance-0000001f</name>
Nov 16 18:11:17 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:11:17 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:11:17 user nova-compute[75342]:   <metadata>
Nov 16 18:11:17 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:11:17 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:11:17 user nova-compute[75342]:       <nova:name>tempest-ServerActionsTestOtherA-server-1621983513</nova:name>
Nov 16 18:11:17 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:11:15</nova:creationTime>
Nov 16 18:11:17 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:11:17 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:11:17 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:11:17 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:11:17 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:11:17 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:11:17 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:11:17 user nova-compute[75342]:       <nova:owner>
Nov 16 18:11:17 user nova-compute[75342]:         <nova:user uuid="1794b9bef4ad42e6aab088f3ef90dba2">tempest-ServerActionsTestOtherA-1650562087-project-member</nova:user>
Nov 16 18:11:17 user nova-compute[75342]:         <nova:project uuid="c78cae892fff433eb216caff3a127a64">tempest-ServerActionsTestOtherA-1650562087</nova:project>
Nov 16 18:11:17 user nova-compute[75342]:       </nova:owner>
Nov 16 18:11:17 user nova-compute[75342]:       <nova:ports>
Nov 16 18:11:17 user nova-compute[75342]:         <nova:port uuid="b0832714-4459-45d7-bf7f-acb458b04551">
Nov 16 18:11:17 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 18:11:17 user nova-compute[75342]:         </nova:port>
Nov 16 18:11:17 user nova-compute[75342]:       </nova:ports>
Nov 16 18:11:17 user nova-compute[75342]:     </nova:instance>
Nov 16 18:11:17 user nova-compute[75342]:   </metadata>
Nov 16 18:11:17 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:11:17 user nova-compute[75342]:     <system>
Nov 16 18:11:17 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:11:17 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:11:17 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:11:17 user nova-compute[75342]:       <entry name="serial">147d9aee-cfd9-4e78-bf35-0ac7e16f6679</entry>
Nov 16 18:11:17 user nova-compute[75342]:       <entry name="uuid">147d9aee-cfd9-4e78-bf35-0ac7e16f6679</entry>
Nov 16 18:11:17 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:11:17 user nova-compute[75342]:     </system>
Nov 16 18:11:17 user nova-compute[75342]:   </sysinfo>
Nov 16 18:11:17 user nova-compute[75342]:   <os>
Nov 16 18:11:17 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:11:17 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:11:17 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:11:17 user nova-compute[75342]:   </os>
Nov 16 18:11:17 user nova-compute[75342]:   <features>
Nov 16 18:11:17 user nova-compute[75342]:     <acpi/>
Nov 16 18:11:17 user nova-compute[75342]:     <apic/>
Nov 16 18:11:17 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:11:17 user nova-compute[75342]:   </features>
Nov 16 18:11:17 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:11:17 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:11:17 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:11:17 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:11:17 user nova-compute[75342]:   </clock>
Nov 16 18:11:17 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:11:17 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:11:17 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:11:17 user nova-compute[75342]:   </cpu>
Nov 16 18:11:17 user nova-compute[75342]:   <devices>
Nov 16 18:11:17 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:11:17 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:11:17 user nova-compute[75342]:       <source dev="/dev/sdg"/>
Nov 16 18:11:17 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:11:17 user nova-compute[75342]:       <serial>62eb0bc9-da13-416b-ae9d-1bf9d700996c</serial>
Nov 16 18:11:17 user nova-compute[75342]:     </disk>
Nov 16 18:11:17 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:11:17 user nova-compute[75342]:       <mac address="fa:16:3e:12:a1:d8"/>
Nov 16 18:11:17 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:11:17 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:11:17 user nova-compute[75342]:       <target dev="tapb0832714-44"/>
Nov 16 18:11:17 user nova-compute[75342]:     </interface>
Nov 16 18:11:17 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:11:17 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/147d9aee-cfd9-4e78-bf35-0ac7e16f6679/console.log" append="off"/>
Nov 16 18:11:17 user nova-compute[75342]:     </serial>
Nov 16 18:11:17 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:11:17 user nova-compute[75342]:     <video>
Nov 16 18:11:17 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:11:17 user nova-compute[75342]:     </video>
Nov 16 18:11:17 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:11:17 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:11:17 user nova-compute[75342]:     </rng>
Nov 16 18:11:17 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:11:17 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:11:17 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:11:17 user nova-compute[75342]:     </memballoon>
Nov 16 18:11:17 user nova-compute[75342]:   </devices>
Nov 16 18:11:17 user nova-compute[75342]: </domain>
Nov 16 18:11:17 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1621983513',display_name='tempest-ServerActionsTestOtherA-server-1621983513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1621983513',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU1men7gMttl3YEQ2iX5okVvx4lpe2gNM2yccK4kETnd8Mrupb252faDCsR3+7xPoiSo7c4DSoVxYlsKd1dOtU+J4xVhSH7sXMEH8ib246uK8ZL45kAm/O/eMxS5d6eeQ==',key_name='tempest-keypair-357673672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-1dkp454h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=147d9aee-cfd9-4e78-bf35-0ac7e16f6679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG os_vif [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08dbfe11-7e5d-59d4-b0e5-7f9c984557d2', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0832714-44, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0832714-44, col_values=(('qos', UUID('c2fe652b-5949-4ea7-b17e-c4ebafee1cdf')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0832714-44, col_values=(('external_ids', {'iface-id': 'b0832714-4459-45d7-bf7f-acb458b04551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:a1:d8', 'vm-uuid': '147d9aee-cfd9-4e78-bf35-0ac7e16f6679'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:11:17 user nova-compute[75342]: INFO nova.compute.claims [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Claim successful on node user
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:17 user nova-compute[75342]: INFO os_vif [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44')
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No VIF found with MAC fa:16:3e:12:a1:d8, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-5923463c-afb0-47d7-9627-81a499c81ed3 req-a0d04340-b08f-49d6-9c7a-c8560237a7d0 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Received event network-vif-plugged-7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5923463c-afb0-47d7-9627-81a499c81ed3 req-a0d04340-b08f-49d6-9c7a-c8560237a7d0 service nova] Acquiring lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5923463c-afb0-47d7-9627-81a499c81ed3 req-a0d04340-b08f-49d6-9c7a-c8560237a7d0 service nova] Lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5923463c-afb0-47d7-9627-81a499c81ed3 req-a0d04340-b08f-49d6-9c7a-c8560237a7d0 service nova] Lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-5923463c-afb0-47d7-9627-81a499c81ed3 req-a0d04340-b08f-49d6-9c7a-c8560237a7d0 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] No waiting events found dispatching network-vif-plugged-7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:11:17 user nova-compute[75342]: WARNING nova.compute.manager [req-5923463c-afb0-47d7-9627-81a499c81ed3 req-a0d04340-b08f-49d6-9c7a-c8560237a7d0 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Received unexpected event network-vif-plugged-7803709a-5b87-4615-8acd-771c12899de8 for instance with vm_state building and task_state spawning.
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:18 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:11:18 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:11:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:11:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:11:18 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:11:18 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:11:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:11:18 user nova-compute[75342]: DEBUG nova.policy [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13beba5fa97a448fa863135a45e47cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542bb854a1647618ba3995c4342109a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:11:18 user nova-compute[75342]: INFO nova.virt.block_device [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Booting with volume-backed-image c3510820-8b2c-4ce9-a892-c10a662aeed6 at /dev/vda
Nov 16 18:11:18 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Successfully created port: 6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:11:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-a76ee195-6c98-41bc-b79e-f0b0b0c30551 req-7fb83e7a-99cb-4b3b-93be-6fbb24d4c727 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a76ee195-6c98-41bc-b79e-f0b0b0c30551 req-7fb83e7a-99cb-4b3b-93be-6fbb24d4c727 service nova] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a76ee195-6c98-41bc-b79e-f0b0b0c30551 req-7fb83e7a-99cb-4b3b-93be-6fbb24d4c727 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a76ee195-6c98-41bc-b79e-f0b0b0c30551 req-7fb83e7a-99cb-4b3b-93be-6fbb24d4c727 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-a76ee195-6c98-41bc-b79e-f0b0b0c30551 req-7fb83e7a-99cb-4b3b-93be-6fbb24d4c727 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] No waiting events found dispatching network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:11:19 user nova-compute[75342]: WARNING nova.compute.manager [req-a76ee195-6c98-41bc-b79e-f0b0b0c30551 req-7fb83e7a-99cb-4b3b-93be-6fbb24d4c727 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received unexpected event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 for instance with vm_state building and task_state spawning.
Nov 16 18:11:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-feea2d6a-4756-45aa-bc77-f9fc3e80b007 req-29a2862c-9458-49c2-9f83-2ae81b6bc093 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Received event network-vif-plugged-7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-feea2d6a-4756-45aa-bc77-f9fc3e80b007 req-29a2862c-9458-49c2-9f83-2ae81b6bc093 service nova] Acquiring lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-feea2d6a-4756-45aa-bc77-f9fc3e80b007 req-29a2862c-9458-49c2-9f83-2ae81b6bc093 service nova] Lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-feea2d6a-4756-45aa-bc77-f9fc3e80b007 req-29a2862c-9458-49c2-9f83-2ae81b6bc093 service nova] Lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-feea2d6a-4756-45aa-bc77-f9fc3e80b007 req-29a2862c-9458-49c2-9f83-2ae81b6bc093 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] No waiting events found dispatching network-vif-plugged-7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:11:20 user nova-compute[75342]: WARNING nova.compute.manager [req-feea2d6a-4756-45aa-bc77-f9fc3e80b007 req-29a2862c-9458-49c2-9f83-2ae81b6bc093 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Received unexpected event network-vif-plugged-7803709a-5b87-4615-8acd-771c12899de8 for instance with vm_state building and task_state spawning.
Nov 16 18:11:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Successfully updated port: 6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquired lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Updating instance_info_cache with network_info: [{"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Releasing lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Instance network_info: |[{"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:11:21 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Instance spawned successfully.
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:21 user nova-compute[75342]: INFO nova.compute.manager [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Took 6.45 seconds to spawn the instance on the hypervisor.
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:11:21 user nova-compute[75342]: INFO nova.compute.manager [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Took 18.62 seconds to build instance.
Nov 16 18:11:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-047ff4b3-44b1-410e-9651-357ebac80eee tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "6a4d9392-83e5-4423-90ce-18283717f5df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.763s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-changed-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Refreshing instance network info cache due to event network-changed-6867e53c-2663-4167-9934-1fccd82b160e. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] Acquiring lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] Acquired lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.network.neutron [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Refreshing network info cache for port 6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:11:21 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Instance spawned successfully.
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:21 user nova-compute[75342]: INFO nova.compute.manager [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Took 6.72 seconds to spawn the instance on the hypervisor.
Nov 16 18:11:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:11:21 user nova-compute[75342]: INFO nova.compute.manager [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Took 12.95 seconds to build instance.
Nov 16 18:11:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-88f29450-db90-4ece-803f-94f8048b8f14 tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.050s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:22 user nova-compute[75342]: DEBUG nova.network.neutron [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Updated VIF entry in instance network info cache for port 6867e53c-2663-4167-9934-1fccd82b160e. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:11:22 user nova-compute[75342]: DEBUG nova.network.neutron [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Updating instance_info_cache with network_info: [{"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] Releasing lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] No waiting events found dispatching network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:11:22 user nova-compute[75342]: WARNING nova.compute.manager [req-89cb4ff3-72fa-44aa-94ef-04cf18a456be req-dc09155a-054c-4dd7-9bf8-7c2e8acfc533 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received unexpected event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 for instance with vm_state building and task_state spawning.
Nov 16 18:11:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG os_brick.utils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7cff5e-2fcc-4550-b7b5-62e86b9ca44b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af64e7e-bf2f-4b79-a1e8-1400ac93bab4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7430226-6fef-4f60-84fc-a2e16c3f4e6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e88ada5-468e-4e9a-9435-82f743be2f97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:11:24 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:11:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7538f7-3427-4369-8469-7f88c8f5a937]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG os_brick.utils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:11:24 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Updating existing volume attachment record: 22d5406d-5f14-4ed9-be64-d3701199c56b {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:11:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:11:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:26 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:11:26 user nova-compute[75342]: INFO nova.compute.claims [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Claim successful on node user
Nov 16 18:11:27 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:11:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:11:27 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG nova.policy [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5976cde7fade404fac5146e3952cc95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b314838880c4cf68c74b2a215fa0a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:11:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Creating image(s)
Nov 16 18:11:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "/opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "/opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "/opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.192s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.204s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk 1073741824" returned: 0 in 0.054s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Successfully created port: a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.220s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Cannot resize image /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Ensure instance console log exists: /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Successfully updated port: a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquired lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-1d840b8a-8a38-4fde-b560-aa05245d9df2 req-6e627bd4-31d4-4800-88b4-6d5635ba7d50 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-changed-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-1d840b8a-8a38-4fde-b560-aa05245d9df2 req-6e627bd4-31d4-4800-88b4-6d5635ba7d50 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Refreshing instance network info cache due to event network-changed-a81da486-f0aa-446c-8682-d37aea664738. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1d840b8a-8a38-4fde-b560-aa05245d9df2 req-6e627bd4-31d4-4800-88b4-6d5635ba7d50 service nova] Acquiring lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:28 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updating instance_info_cache with network_info: [{"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Releasing lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Instance network_info: |[{"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1d840b8a-8a38-4fde-b560-aa05245d9df2 req-6e627bd4-31d4-4800-88b4-6d5635ba7d50 service nova] Acquired lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.network.neutron [req-1d840b8a-8a38-4fde-b560-aa05245d9df2 req-6e627bd4-31d4-4800-88b4-6d5635ba7d50 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Refreshing network info cache for port a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Start _get_guest_xml network_info=[{"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:11:29 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:29 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1820588361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1820588361',id=33,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP5DtxWdGwxM/d1hsyt2mQTYeKWcOFtoSPQ5b4E2L6TQIIA18JIlNqXNV7CVub0oAkDX93T4/krIINufmG3TeA/Jah0HxbBoOZgsCK8a8QOI2ExAuLhoZN2jkOUV6V43w==',key_name='tempest-keypair-1106578881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-wuca4hmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=06eb90ec-da8e-46c1-9401-b9613ebe92c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.objects.instance [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'pci_devices' on Instance uuid 06eb90ec-da8e-46c1-9401-b9613ebe92c0 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:11:29 user nova-compute[75342]:   <uuid>06eb90ec-da8e-46c1-9401-b9613ebe92c0</uuid>
Nov 16 18:11:29 user nova-compute[75342]:   <name>instance-00000021</name>
Nov 16 18:11:29 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:11:29 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:11:29 user nova-compute[75342]:   <metadata>
Nov 16 18:11:29 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:11:29 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:11:29 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1820588361</nova:name>
Nov 16 18:11:29 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:11:29</nova:creationTime>
Nov 16 18:11:29 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:11:29 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:11:29 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:11:29 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:11:29 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:11:29 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:11:29 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:11:29 user nova-compute[75342]:       <nova:owner>
Nov 16 18:11:29 user nova-compute[75342]:         <nova:user uuid="5976cde7fade404fac5146e3952cc95f">tempest-AttachVolumeShelveTestJSON-1298817282-project-member</nova:user>
Nov 16 18:11:29 user nova-compute[75342]:         <nova:project uuid="2b314838880c4cf68c74b2a215fa0a78">tempest-AttachVolumeShelveTestJSON-1298817282</nova:project>
Nov 16 18:11:29 user nova-compute[75342]:       </nova:owner>
Nov 16 18:11:29 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:11:29 user nova-compute[75342]:       <nova:ports>
Nov 16 18:11:29 user nova-compute[75342]:         <nova:port uuid="a81da486-f0aa-446c-8682-d37aea664738">
Nov 16 18:11:29 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 18:11:29 user nova-compute[75342]:         </nova:port>
Nov 16 18:11:29 user nova-compute[75342]:       </nova:ports>
Nov 16 18:11:29 user nova-compute[75342]:     </nova:instance>
Nov 16 18:11:29 user nova-compute[75342]:   </metadata>
Nov 16 18:11:29 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:11:29 user nova-compute[75342]:     <system>
Nov 16 18:11:29 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:11:29 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:11:29 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:11:29 user nova-compute[75342]:       <entry name="serial">06eb90ec-da8e-46c1-9401-b9613ebe92c0</entry>
Nov 16 18:11:29 user nova-compute[75342]:       <entry name="uuid">06eb90ec-da8e-46c1-9401-b9613ebe92c0</entry>
Nov 16 18:11:29 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:11:29 user nova-compute[75342]:     </system>
Nov 16 18:11:29 user nova-compute[75342]:   </sysinfo>
Nov 16 18:11:29 user nova-compute[75342]:   <os>
Nov 16 18:11:29 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:11:29 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:11:29 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:11:29 user nova-compute[75342]:   </os>
Nov 16 18:11:29 user nova-compute[75342]:   <features>
Nov 16 18:11:29 user nova-compute[75342]:     <acpi/>
Nov 16 18:11:29 user nova-compute[75342]:     <apic/>
Nov 16 18:11:29 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:11:29 user nova-compute[75342]:   </features>
Nov 16 18:11:29 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:11:29 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:11:29 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:11:29 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:11:29 user nova-compute[75342]:   </clock>
Nov 16 18:11:29 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:11:29 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:11:29 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:11:29 user nova-compute[75342]:   </cpu>
Nov 16 18:11:29 user nova-compute[75342]:   <devices>
Nov 16 18:11:29 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:11:29 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:11:29 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk"/>
Nov 16 18:11:29 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:11:29 user nova-compute[75342]:     </disk>
Nov 16 18:11:29 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:11:29 user nova-compute[75342]:       <mac address="fa:16:3e:cf:0b:65"/>
Nov 16 18:11:29 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:11:29 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:11:29 user nova-compute[75342]:       <target dev="tapa81da486-f0"/>
Nov 16 18:11:29 user nova-compute[75342]:     </interface>
Nov 16 18:11:29 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:11:29 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/console.log" append="off"/>
Nov 16 18:11:29 user nova-compute[75342]:     </serial>
Nov 16 18:11:29 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:11:29 user nova-compute[75342]:     <video>
Nov 16 18:11:29 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:11:29 user nova-compute[75342]:     </video>
Nov 16 18:11:29 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:11:29 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:11:29 user nova-compute[75342]:     </rng>
Nov 16 18:11:29 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:11:29 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:11:29 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:11:29 user nova-compute[75342]:     </memballoon>
Nov 16 18:11:29 user nova-compute[75342]:   </devices>
Nov 16 18:11:29 user nova-compute[75342]: </domain>
Nov 16 18:11:29 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1820588361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1820588361',id=33,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP5DtxWdGwxM/d1hsyt2mQTYeKWcOFtoSPQ5b4E2L6TQIIA18JIlNqXNV7CVub0oAkDX93T4/krIINufmG3TeA/Jah0HxbBoOZgsCK8a8QOI2ExAuLhoZN2jkOUV6V43w==',key_name='tempest-keypair-1106578881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-wuca4hmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=06eb90ec-da8e-46c1-9401-b9613ebe92c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG os_vif [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bef00d9-2aec-5142-83bd-6ea66319bbb6', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa81da486-f0, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa81da486-f0, col_values=(('qos', UUID('fdbf2c92-2f12-43a8-9c4f-9a8aff3ae5f7')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa81da486-f0, col_values=(('external_ids', {'iface-id': 'a81da486-f0aa-446c-8682-d37aea664738', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:0b:65', 'vm-uuid': '06eb90ec-da8e-46c1-9401-b9613ebe92c0'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:29 user nova-compute[75342]: INFO os_vif [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0')
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] No VIF found with MAC fa:16:3e:cf:0b:65, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.network.neutron [req-1d840b8a-8a38-4fde-b560-aa05245d9df2 req-6e627bd4-31d4-4800-88b4-6d5635ba7d50 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updated VIF entry in instance network info cache for port a81da486-f0aa-446c-8682-d37aea664738. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG nova.network.neutron [req-1d840b8a-8a38-4fde-b560-aa05245d9df2 req-6e627bd4-31d4-4800-88b4-6d5635ba7d50 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updating instance_info_cache with network_info: [{"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1d840b8a-8a38-4fde-b560-aa05245d9df2 req-6e627bd4-31d4-4800-88b4-6d5635ba7d50 service nova] Releasing lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-e51aa7c6-f597-49a2-8d09-29f97ae081d4 req-9816e71e-de29-40e1-bc0e-c7f46d2b7516 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e51aa7c6-f597-49a2-8d09-29f97ae081d4 req-9816e71e-de29-40e1-bc0e-c7f46d2b7516 service nova] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e51aa7c6-f597-49a2-8d09-29f97ae081d4 req-9816e71e-de29-40e1-bc0e-c7f46d2b7516 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e51aa7c6-f597-49a2-8d09-29f97ae081d4 req-9816e71e-de29-40e1-bc0e-c7f46d2b7516 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-e51aa7c6-f597-49a2-8d09-29f97ae081d4 req-9816e71e-de29-40e1-bc0e-c7f46d2b7516 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] No waiting events found dispatching network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:11:31 user nova-compute[75342]: WARNING nova.compute.manager [req-e51aa7c6-f597-49a2-8d09-29f97ae081d4 req-9816e71e-de29-40e1-bc0e-c7f46d2b7516 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received unexpected event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 for instance with vm_state building and task_state spawning.
Nov 16 18:11:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:11:31 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Creating image(s)
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Ensure instance console log exists: /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Start _get_guest_xml network_info=[{"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '22d5406d-5f14-4ed9-be64-d3701199c56b', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCMdjWuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c82d7adf-64ed-4573-9b2f-58c1daab2651', 'attached_at': '', 'detached_at': '', 'volume_id': '335277d4-b4fa-4f08-a27e-20f9fc786c5b', 'serial': '335277d4-b4fa-4f08-a27e-20f9fc786c5b'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:11:31 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:31 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCMdjWuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:11:31 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:11:31 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:11:31 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d9580c-90c7-4124-8ae1-27b9a5f264e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:11:31 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a28ed1-9c2c-4b79-9969-a30bf2c143c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b] added
Nov 16 18:11:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c42aab6-c982-43e0-b580-182f3c79322a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[969421bb-b30e-4c60-b43f-374bbbd5c637]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCMdjWuV {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCMdjWuV" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b61f32d-f88e-443e-945b-939b23eb4ba1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PCMdjWuV'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[16589c9a-156a-40b8-9891-bd4c565c2f8f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbfe928-63d9-425b-aba4-29ae31768921]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:31 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:31 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:31 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:31 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:11:31 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:11:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:11:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:31 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:31 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:31 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:31 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:11:31 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:11:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[806dee4f-6270-4a4e-ae83-aa66bb51ec73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b, portal: 172.16.0.220,3260]
Nov 16 18:11:32 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b, portal: 172.16.0.220,3260] successful.
Nov 16 18:11:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f66476-0311-47b6-a338-6fc14ef7ba32]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[622af33a-e176-4fd0-bb2f-8d37391bc6f3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:11:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:11:32 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:11:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] HCTL ('39', '-', '-', 0) found on session 36 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.038s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c4a4f-22b0-4ccf-b263-9782a09a0d4a]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching for a device in session 36 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCMdjWuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:32 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:11:32 user nova-compute[75342]: INFO nova.compute.claims [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Claim successful on node user
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:11:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Instance spawned successfully.
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23532356263336263', 'path': '/dev/sdh'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532356263336263', 'path': '/dev/sdh'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-b45dc964-5e1e-4e7a-b0ca-cecbf50b3b60 req-9e038c00-3341-49d4-82fe-f94b458bc990 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b45dc964-5e1e-4e7a-b0ca-cecbf50b3b60 req-9e038c00-3341-49d4-82fe-f94b458bc990 service nova] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b45dc964-5e1e-4e7a-b0ca-cecbf50b3b60 req-9e038c00-3341-49d4-82fe-f94b458bc990 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b45dc964-5e1e-4e7a-b0ca-cecbf50b3b60 req-9e038c00-3341-49d4-82fe-f94b458bc990 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-b45dc964-5e1e-4e7a-b0ca-cecbf50b3b60 req-9e038c00-3341-49d4-82fe-f94b458bc990 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] No waiting events found dispatching network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:11:33 user nova-compute[75342]: WARNING nova.compute.manager [req-b45dc964-5e1e-4e7a-b0ca-cecbf50b3b60 req-9e038c00-3341-49d4-82fe-f94b458bc990 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received unexpected event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 for instance with vm_state building and task_state spawning.
Nov 16 18:11:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1447790317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1447790317',id=32,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-ulwm4ntp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:18Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=c82d7adf-64ed-4573-9b2f-58c1daab2651,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:dd,bridge_name='br-int',has_traffic_filtering=True,id=6867e53c-2663-4167-9934-1fccd82b160e,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6867e53c-26') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.objects.instance [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'pci_devices' on Instance uuid c82d7adf-64ed-4573-9b2f-58c1daab2651 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:11:33 user nova-compute[75342]:   <uuid>c82d7adf-64ed-4573-9b2f-58c1daab2651</uuid>
Nov 16 18:11:33 user nova-compute[75342]:   <name>instance-00000020</name>
Nov 16 18:11:33 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:11:33 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:11:33 user nova-compute[75342]:   <metadata>
Nov 16 18:11:33 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:11:33 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:11:33 user nova-compute[75342]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1447790317</nova:name>
Nov 16 18:11:33 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:11:31</nova:creationTime>
Nov 16 18:11:33 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:11:33 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:11:33 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:11:33 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:11:33 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:11:33 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:11:33 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:11:33 user nova-compute[75342]:       <nova:owner>
Nov 16 18:11:33 user nova-compute[75342]:         <nova:user uuid="13beba5fa97a448fa863135a45e47cb9">tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member</nova:user>
Nov 16 18:11:33 user nova-compute[75342]:         <nova:project uuid="4542bb854a1647618ba3995c4342109a">tempest-ServerBootFromVolumeStableRescueTest-764398626</nova:project>
Nov 16 18:11:33 user nova-compute[75342]:       </nova:owner>
Nov 16 18:11:33 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:11:33 user nova-compute[75342]:       <nova:ports>
Nov 16 18:11:33 user nova-compute[75342]:         <nova:port uuid="6867e53c-2663-4167-9934-1fccd82b160e">
Nov 16 18:11:33 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 18:11:33 user nova-compute[75342]:         </nova:port>
Nov 16 18:11:33 user nova-compute[75342]:       </nova:ports>
Nov 16 18:11:33 user nova-compute[75342]:     </nova:instance>
Nov 16 18:11:33 user nova-compute[75342]:   </metadata>
Nov 16 18:11:33 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:11:33 user nova-compute[75342]:     <system>
Nov 16 18:11:33 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:11:33 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:11:33 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:11:33 user nova-compute[75342]:       <entry name="serial">c82d7adf-64ed-4573-9b2f-58c1daab2651</entry>
Nov 16 18:11:33 user nova-compute[75342]:       <entry name="uuid">c82d7adf-64ed-4573-9b2f-58c1daab2651</entry>
Nov 16 18:11:33 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:11:33 user nova-compute[75342]:     </system>
Nov 16 18:11:33 user nova-compute[75342]:   </sysinfo>
Nov 16 18:11:33 user nova-compute[75342]:   <os>
Nov 16 18:11:33 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:11:33 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:11:33 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:11:33 user nova-compute[75342]:   </os>
Nov 16 18:11:33 user nova-compute[75342]:   <features>
Nov 16 18:11:33 user nova-compute[75342]:     <acpi/>
Nov 16 18:11:33 user nova-compute[75342]:     <apic/>
Nov 16 18:11:33 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:11:33 user nova-compute[75342]:   </features>
Nov 16 18:11:33 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:11:33 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:11:33 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:11:33 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:11:33 user nova-compute[75342]:   </clock>
Nov 16 18:11:33 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:11:33 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:11:33 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:11:33 user nova-compute[75342]:   </cpu>
Nov 16 18:11:33 user nova-compute[75342]:   <devices>
Nov 16 18:11:33 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:11:33 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:11:33 user nova-compute[75342]:       <source dev="/dev/sdh"/>
Nov 16 18:11:33 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:11:33 user nova-compute[75342]:       <serial>335277d4-b4fa-4f08-a27e-20f9fc786c5b</serial>
Nov 16 18:11:33 user nova-compute[75342]:     </disk>
Nov 16 18:11:33 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:11:33 user nova-compute[75342]:       <mac address="fa:16:3e:5f:37:dd"/>
Nov 16 18:11:33 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:11:33 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:11:33 user nova-compute[75342]:       <target dev="tap6867e53c-26"/>
Nov 16 18:11:33 user nova-compute[75342]:     </interface>
Nov 16 18:11:33 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:11:33 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/console.log" append="off"/>
Nov 16 18:11:33 user nova-compute[75342]:     </serial>
Nov 16 18:11:33 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:11:33 user nova-compute[75342]:     <video>
Nov 16 18:11:33 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:11:33 user nova-compute[75342]:     </video>
Nov 16 18:11:33 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:11:33 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:11:33 user nova-compute[75342]:     </rng>
Nov 16 18:11:33 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:11:33 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:11:33 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:11:33 user nova-compute[75342]:     </memballoon>
Nov 16 18:11:33 user nova-compute[75342]:   </devices>
Nov 16 18:11:33 user nova-compute[75342]: </domain>
Nov 16 18:11:33 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1447790317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1447790317',id=32,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-ulwm4ntp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:18Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=c82d7adf-64ed-4573-9b2f-58c1daab2651,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:dd,bridge_name='br-int',has_traffic_filtering=True,id=6867e53c-2663-4167-9934-1fccd82b160e,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6867e53c-26') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG os_vif [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:dd,bridge_name='br-int',has_traffic_filtering=True,id=6867e53c-2663-4167-9934-1fccd82b160e,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6867e53c-26') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1c47ad2-927f-583d-9391-7ea92e50d18b', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6867e53c-26, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6867e53c-26, col_values=(('qos', UUID('cdb549fb-9e40-4057-a8a6-705ec030e060')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6867e53c-26, col_values=(('external_ids', {'iface-id': '6867e53c-2663-4167-9934-1fccd82b160e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:37:dd', 'vm-uuid': 'c82d7adf-64ed-4573-9b2f-58c1daab2651'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:33 user nova-compute[75342]: INFO os_vif [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:dd,bridge_name='br-int',has_traffic_filtering=True,id=6867e53c-2663-4167-9934-1fccd82b160e,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6867e53c-26')
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:11:33 user nova-compute[75342]: INFO nova.compute.manager [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.policy [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0697a15cd0054cef90459da99a3fd8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d87f343b6e4dbead83e037619ae49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No VIF found with MAC fa:16:3e:5f:37:dd, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:11:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Creating image(s)
Nov 16 18:11:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "/opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:33 user nova-compute[75342]: INFO nova.compute.manager [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Took 7.16 seconds to build instance.
Nov 16 18:11:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0dfcd2a6-fdd4-4782-a684-7ba00f9c27f1 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.325s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.266s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.213s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk 1073741824" returned: 0 in 0.072s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.357s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Successfully created port: 01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Cannot resize image /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Ensure instance console log exists: /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-3414d7a5-1496-4c2c-a348-ce5ee7bd5def req-b5f96052-7227-40ad-ab91-017a43b781d2 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3414d7a5-1496-4c2c-a348-ce5ee7bd5def req-b5f96052-7227-40ad-ab91-017a43b781d2 service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3414d7a5-1496-4c2c-a348-ce5ee7bd5def req-b5f96052-7227-40ad-ab91-017a43b781d2 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3414d7a5-1496-4c2c-a348-ce5ee7bd5def req-b5f96052-7227-40ad-ab91-017a43b781d2 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-3414d7a5-1496-4c2c-a348-ce5ee7bd5def req-b5f96052-7227-40ad-ab91-017a43b781d2 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:11:35 user nova-compute[75342]: WARNING nova.compute.manager [req-3414d7a5-1496-4c2c-a348-ce5ee7bd5def req-b5f96052-7227-40ad-ab91-017a43b781d2 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received unexpected event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with vm_state building and task_state spawning.
Nov 16 18:11:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Successfully updated port: 01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquired lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-21e8eb24-3622-4658-b3e4-171218435146 req-aaf6b1ce-0d0f-48dd-9008-05bea255b672 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-changed-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-21e8eb24-3622-4658-b3e4-171218435146 req-aaf6b1ce-0d0f-48dd-9008-05bea255b672 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Refreshing instance network info cache due to event network-changed-01f59d58-7783-45da-bc6c-5834a6924118. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-21e8eb24-3622-4658-b3e4-171218435146 req-aaf6b1ce-0d0f-48dd-9008-05bea255b672 service nova] Acquiring lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:35 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updating instance_info_cache with network_info: [{"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Releasing lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Instance network_info: |[{"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-21e8eb24-3622-4658-b3e4-171218435146 req-aaf6b1ce-0d0f-48dd-9008-05bea255b672 service nova] Acquired lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.network.neutron [req-21e8eb24-3622-4658-b3e4-171218435146 req-aaf6b1ce-0d0f-48dd-9008-05bea255b672 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Refreshing network info cache for port 01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Start _get_guest_xml network_info=[{"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:11:36 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:36 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-312026651',display_name='tempest-ServerRescueNegativeTestJSON-server-312026651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-312026651',id=34,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA26q3PLEG430qQKUG7KVHVR1G1xH6/5zkOYUuj6Uf9b3zgk5ntrZk6vFHpepH7LfPKXhlO8sApShsL0bdYrqRWyzpKEe2UwkxAz2JacyKrsu43gCO+MYiAcuvjbmWvpKg==',key_name='tempest-keypair-614923427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-gli1u0lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:cc,bridge_name='br-int',has_traffic_filtering=True,id=01f59d58-7783-45da-bc6c-5834a6924118,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f59d58-77') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'pci_devices' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:11:36 user nova-compute[75342]:   <uuid>9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c</uuid>
Nov 16 18:11:36 user nova-compute[75342]:   <name>instance-00000022</name>
Nov 16 18:11:36 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:11:36 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:11:36 user nova-compute[75342]:   <metadata>
Nov 16 18:11:36 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:11:36 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:11:36 user nova-compute[75342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-312026651</nova:name>
Nov 16 18:11:36 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:11:36</nova:creationTime>
Nov 16 18:11:36 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:11:36 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:11:36 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:11:36 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:11:36 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:11:36 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:11:36 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:11:36 user nova-compute[75342]:       <nova:owner>
Nov 16 18:11:36 user nova-compute[75342]:         <nova:user uuid="0697a15cd0054cef90459da99a3fd8ec">tempest-ServerRescueNegativeTestJSON-935902109-project-member</nova:user>
Nov 16 18:11:36 user nova-compute[75342]:         <nova:project uuid="02d87f343b6e4dbead83e037619ae49c">tempest-ServerRescueNegativeTestJSON-935902109</nova:project>
Nov 16 18:11:36 user nova-compute[75342]:       </nova:owner>
Nov 16 18:11:36 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:11:36 user nova-compute[75342]:       <nova:ports>
Nov 16 18:11:36 user nova-compute[75342]:         <nova:port uuid="01f59d58-7783-45da-bc6c-5834a6924118">
Nov 16 18:11:36 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 18:11:36 user nova-compute[75342]:         </nova:port>
Nov 16 18:11:36 user nova-compute[75342]:       </nova:ports>
Nov 16 18:11:36 user nova-compute[75342]:     </nova:instance>
Nov 16 18:11:36 user nova-compute[75342]:   </metadata>
Nov 16 18:11:36 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:11:36 user nova-compute[75342]:     <system>
Nov 16 18:11:36 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:11:36 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:11:36 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:11:36 user nova-compute[75342]:       <entry name="serial">9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c</entry>
Nov 16 18:11:36 user nova-compute[75342]:       <entry name="uuid">9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c</entry>
Nov 16 18:11:36 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:11:36 user nova-compute[75342]:     </system>
Nov 16 18:11:36 user nova-compute[75342]:   </sysinfo>
Nov 16 18:11:36 user nova-compute[75342]:   <os>
Nov 16 18:11:36 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:11:36 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:11:36 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:11:36 user nova-compute[75342]:   </os>
Nov 16 18:11:36 user nova-compute[75342]:   <features>
Nov 16 18:11:36 user nova-compute[75342]:     <acpi/>
Nov 16 18:11:36 user nova-compute[75342]:     <apic/>
Nov 16 18:11:36 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:11:36 user nova-compute[75342]:   </features>
Nov 16 18:11:36 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:11:36 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:11:36 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:11:36 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:11:36 user nova-compute[75342]:   </clock>
Nov 16 18:11:36 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:11:36 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:11:36 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:11:36 user nova-compute[75342]:   </cpu>
Nov 16 18:11:36 user nova-compute[75342]:   <devices>
Nov 16 18:11:36 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:11:36 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:11:36 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk"/>
Nov 16 18:11:36 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:11:36 user nova-compute[75342]:     </disk>
Nov 16 18:11:36 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:11:36 user nova-compute[75342]:       <mac address="fa:16:3e:1e:4f:cc"/>
Nov 16 18:11:36 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:11:36 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:11:36 user nova-compute[75342]:       <target dev="tap01f59d58-77"/>
Nov 16 18:11:36 user nova-compute[75342]:     </interface>
Nov 16 18:11:36 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:11:36 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/console.log" append="off"/>
Nov 16 18:11:36 user nova-compute[75342]:     </serial>
Nov 16 18:11:36 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:11:36 user nova-compute[75342]:     <video>
Nov 16 18:11:36 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:11:36 user nova-compute[75342]:     </video>
Nov 16 18:11:36 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:11:36 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:11:36 user nova-compute[75342]:     </rng>
Nov 16 18:11:36 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:11:36 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:11:36 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:11:36 user nova-compute[75342]:     </memballoon>
Nov 16 18:11:36 user nova-compute[75342]:   </devices>
Nov 16 18:11:36 user nova-compute[75342]: </domain>
Nov 16 18:11:36 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-312026651',display_name='tempest-ServerRescueNegativeTestJSON-server-312026651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-312026651',id=34,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA26q3PLEG430qQKUG7KVHVR1G1xH6/5zkOYUuj6Uf9b3zgk5ntrZk6vFHpepH7LfPKXhlO8sApShsL0bdYrqRWyzpKEe2UwkxAz2JacyKrsu43gCO+MYiAcuvjbmWvpKg==',key_name='tempest-keypair-614923427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-gli1u0lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:cc,bridge_name='br-int',has_traffic_filtering=True,id=01f59d58-7783-45da-bc6c-5834a6924118,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f59d58-77') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG os_vif [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:cc,bridge_name='br-int',has_traffic_filtering=True,id=01f59d58-7783-45da-bc6c-5834a6924118,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f59d58-77') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0941fd3f-6aa9-5031-a941-5ca80f457ca4', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01f59d58-77, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01f59d58-77, col_values=(('qos', UUID('e7349448-51ab-4fce-8a8b-350fb53c86a6')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01f59d58-77, col_values=(('external_ids', {'iface-id': '01f59d58-7783-45da-bc6c-5834a6924118', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:4f:cc', 'vm-uuid': '9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:36 user nova-compute[75342]: INFO os_vif [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:cc,bridge_name='br-int',has_traffic_filtering=True,id=01f59d58-7783-45da-bc6c-5834a6924118,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f59d58-77')
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No VIF found with MAC fa:16:3e:1e:4f:cc, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.network.neutron [req-21e8eb24-3622-4658-b3e4-171218435146 req-aaf6b1ce-0d0f-48dd-9008-05bea255b672 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updated VIF entry in instance network info cache for port 01f59d58-7783-45da-bc6c-5834a6924118. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG nova.network.neutron [req-21e8eb24-3622-4658-b3e4-171218435146 req-aaf6b1ce-0d0f-48dd-9008-05bea255b672 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updating instance_info_cache with network_info: [{"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-21e8eb24-3622-4658-b3e4-171218435146 req-aaf6b1ce-0d0f-48dd-9008-05bea255b672 service nova] Releasing lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-817ae8d1-5a68-49c9-bd9d-d392c0d3da05 req-74525396-65c3-43be-aa91-a57ca6f316e8 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-817ae8d1-5a68-49c9-bd9d-d392c0d3da05 req-74525396-65c3-43be-aa91-a57ca6f316e8 service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-817ae8d1-5a68-49c9-bd9d-d392c0d3da05 req-74525396-65c3-43be-aa91-a57ca6f316e8 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-817ae8d1-5a68-49c9-bd9d-d392c0d3da05 req-74525396-65c3-43be-aa91-a57ca6f316e8 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-817ae8d1-5a68-49c9-bd9d-d392c0d3da05 req-74525396-65c3-43be-aa91-a57ca6f316e8 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:11:37 user nova-compute[75342]: WARNING nova.compute.manager [req-817ae8d1-5a68-49c9-bd9d-d392c0d3da05 req-74525396-65c3-43be-aa91-a57ca6f316e8 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received unexpected event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with vm_state building and task_state spawning.
Nov 16 18:11:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:11:38 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Instance spawned successfully.
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:38 user nova-compute[75342]: INFO nova.compute.manager [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-5228fbd2-c71e-4b10-9f4e-c52bdc9dd129 req-cb3f7be3-6cce-4b67-a84c-a802df587b67 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5228fbd2-c71e-4b10-9f4e-c52bdc9dd129 req-cb3f7be3-6cce-4b67-a84c-a802df587b67 service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5228fbd2-c71e-4b10-9f4e-c52bdc9dd129 req-cb3f7be3-6cce-4b67-a84c-a802df587b67 service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5228fbd2-c71e-4b10-9f4e-c52bdc9dd129 req-cb3f7be3-6cce-4b67-a84c-a802df587b67 service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-5228fbd2-c71e-4b10-9f4e-c52bdc9dd129 req-cb3f7be3-6cce-4b67-a84c-a802df587b67 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:11:38 user nova-compute[75342]: WARNING nova.compute.manager [req-5228fbd2-c71e-4b10-9f4e-c52bdc9dd129 req-cb3f7be3-6cce-4b67-a84c-a802df587b67 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state building and task_state spawning.
Nov 16 18:11:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:38 user nova-compute[75342]: INFO nova.compute.manager [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Took 20.75 seconds to build instance.
Nov 16 18:11:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bcfc91a4-1095-40fd-871f-f7cf487122e6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.883s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:39 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:11:39 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.compute.manager [req-32d9f26a-7ffb-4445-8eef-7cdf6b07f915 req-33140350-9e28-401d-b6d8-53118900a8d2 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-32d9f26a-7ffb-4445-8eef-7cdf6b07f915 req-33140350-9e28-401d-b6d8-53118900a8d2 service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-32d9f26a-7ffb-4445-8eef-7cdf6b07f915 req-33140350-9e28-401d-b6d8-53118900a8d2 service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-32d9f26a-7ffb-4445-8eef-7cdf6b07f915 req-33140350-9e28-401d-b6d8-53118900a8d2 service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.compute.manager [req-32d9f26a-7ffb-4445-8eef-7cdf6b07f915 req-33140350-9e28-401d-b6d8-53118900a8d2 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:11:40 user nova-compute[75342]: WARNING nova.compute.manager [req-32d9f26a-7ffb-4445-8eef-7cdf6b07f915 req-33140350-9e28-401d-b6d8-53118900a8d2 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state building and task_state spawning.
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:11:40 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Instance spawned successfully.
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:11:40 user nova-compute[75342]: INFO nova.compute.manager [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 16 18:11:40 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:11:40 user nova-compute[75342]: INFO nova.compute.manager [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Took 8.11 seconds to build instance.
Nov 16 18:11:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c01425e-13c9-43cf-9440-9e6d57b6cd19 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.218s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:41 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:11:41 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:11:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:11:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:11:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:11:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-c6408c85-ed86-4b11-afa6-14f93b92492c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-c6408c85-ed86-4b11-afa6-14f93b92492c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:43 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:11:43 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Updating instance_info_cache with network_info: [{"id": "99579047-4ff0-4461-b833-102b0ee49c64", "address": "fa:16:3e:8d:b1:25", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99579047-4f", "ovs_interfaceid": "99579047-4ff0-4461-b833-102b0ee49c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-c6408c85-ed86-4b11-afa6-14f93b92492c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:11:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:11:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:11:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:11:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:11:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:11:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:11:48 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:48 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:11:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7060MB free_disk=25.197402954101562GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:11:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c6408c85-ed86-4b11-afa6-14f93b92492c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 120e116f-a0e5-406c-9883-6f173da89100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 1ce7aa5b-319e-4167-afc8-bcacd55fd794 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d4c63c32-8406-4498-b4de-8e8ecbc2a173 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 6a4d9392-83e5-4423-90ce-18283717f5df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c82d7adf-64ed-4573-9b2f-58c1daab2651 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 06eb90ec-da8e-46c1-9401-b9613ebe92c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:11:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:11:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:51 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:11:51 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:11:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-89bc4ea0-516d-469c-bd40-9c900094e5cb req-04d5dada-96b8-49f9-a4d6-a11cbcf1d976 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-changed-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-89bc4ea0-516d-469c-bd40-9c900094e5cb req-04d5dada-96b8-49f9-a4d6-a11cbcf1d976 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Refreshing instance network info cache due to event network-changed-1f0e212f-0cb1-47be-b27f-90feb2b3568f. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-89bc4ea0-516d-469c-bd40-9c900094e5cb req-04d5dada-96b8-49f9-a4d6-a11cbcf1d976 service nova] Acquiring lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-89bc4ea0-516d-469c-bd40-9c900094e5cb req-04d5dada-96b8-49f9-a4d6-a11cbcf1d976 service nova] Acquired lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG nova.network.neutron [req-89bc4ea0-516d-469c-bd40-9c900094e5cb req-04d5dada-96b8-49f9-a4d6-a11cbcf1d976 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Refreshing network info cache for port 1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG nova.network.neutron [req-89bc4ea0-516d-469c-bd40-9c900094e5cb req-04d5dada-96b8-49f9-a4d6-a11cbcf1d976 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updated VIF entry in instance network info cache for port 1f0e212f-0cb1-47be-b27f-90feb2b3568f. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG nova.network.neutron [req-89bc4ea0-516d-469c-bd40-9c900094e5cb req-04d5dada-96b8-49f9-a4d6-a11cbcf1d976 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating instance_info_cache with network_info: [{"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-89bc4ea0-516d-469c-bd40-9c900094e5cb req-04d5dada-96b8-49f9-a4d6-a11cbcf1d976 service nova] Releasing lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:11:58 user nova-compute[75342]: INFO nova.compute.manager [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Shelve offloading
Nov 16 18:11:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:11:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:00 user nova-compute[75342]: WARNING nova.compute.manager [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state active and task_state shelving.
Nov 16 18:12:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:00 user nova-compute[75342]: WARNING nova.compute.manager [req-251ee926-4cb6-4ac2-89b9-16daec9459ab req-10d484bb-ce44-4d51-99dd-4c1fe537c3d0 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state active and task_state shelving.
Nov 16 18:12:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Instance destroyed successfully.
Nov 16 18:12:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquired lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:12:00 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating instance_info_cache with network_info: [{"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Releasing lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG nova.compute.manager [req-8b54129d-e75b-4ea0-a837-555014171b8f req-b0a9007b-2b6d-43ac-a43f-961c6f01a38e service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8b54129d-e75b-4ea0-a837-555014171b8f req-b0a9007b-2b6d-43ac-a43f-961c6f01a38e service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8b54129d-e75b-4ea0-a837-555014171b8f req-b0a9007b-2b6d-43ac-a43f-961c6f01a38e service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8b54129d-e75b-4ea0-a837-555014171b8f req-b0a9007b-2b6d-43ac-a43f-961c6f01a38e service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:01 user nova-compute[75342]: DEBUG nova.compute.manager [req-8b54129d-e75b-4ea0-a837-555014171b8f req-b0a9007b-2b6d-43ac-a43f-961c6f01a38e service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:01 user nova-compute[75342]: WARNING nova.compute.manager [req-8b54129d-e75b-4ea0-a837-555014171b8f req-b0a9007b-2b6d-43ac-a43f-961c6f01a38e service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state active and task_state shelving.
Nov 16 18:12:02 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Instance destroyed successfully.
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.objects.instance [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lazy-loading 'resources' on Instance uuid d4c63c32-8406-4498-b4de-8e8ecbc2a173 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1011058480',display_name='tempest-TestShelveInstance-server-1011058480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1011058480',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiiI+Kbr7I++Ar7wZEVjMsGCaGZwXXvpVLemr4oPu6KcP5xOWW79PL8S3X7CGkmsoOgFJC/vOfwrrHTdTdEv1aDgavC1XoGmY0sba3f9D0T3rFUcp79le5MDwQtusWxOQ==',key_name='tempest-TestShelveInstance-2005458468',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf819660602345c6acdb1caeff5bf347',ramdisk_id='',reservation_id='r-tij2s1qg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2088508252',owner_user_name='tempest-TestShelveInstance-2088508252-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:10:18Z,user_data=None,user_id='ba8b928d71ce4f918f0d5d6bd78b0ebb',uuid=d4c63c32-8406-4498-b4de-8e8ecbc2a173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converting VIF {"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_vif [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f0e212f-0c, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e86cb71e-ed90-4cab-9903-4c44afacdcfd) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:12:02 user nova-compute[75342]: INFO os_vif [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c')
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlBGrdDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:12:02 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.109s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9459012a-9368-40c8-8b73-e11268167d6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3fea316-87b2-4e5f-b6c3-0591a046af95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:02 user nova-compute[75342]: WARNING nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state active and task_state shelving.
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:02 user nova-compute[75342]: WARNING nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state active and task_state shelving.
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:02 user nova-compute[75342]: WARNING nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state active and task_state shelving.
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:02 user nova-compute[75342]: WARNING nova.compute.manager [req-31ed282d-e36a-4dd5-851e-b90e08af5e88 req-5836cf2e-06a4-4c10-8f88-38320f607d31 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state active and task_state shelving.
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:12:02 user nova-compute[75342]: No targets found.
Nov 16 18:12:02 user nova-compute[75342]: iSNS:
Nov 16 18:12:02 user nova-compute[75342]: No targets found.
Nov 16 18:12:02 user nova-compute[75342]: STATIC:
Nov 16 18:12:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:12:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e
Nov 16 18:12:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:d3fea316-87b2-4e5f-b6c3-0591a046af95
Nov 16 18:12:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519
Nov 16 18:12:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:12:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183
Nov 16 18:12:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1
Nov 16 18:12:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:02 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b
Nov 16 18:12:02 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:02 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:02 user nova-compute[75342]: FIRMWARE:
Nov 16 18:12:02 user nova-compute[75342]: No targets found.
Nov 16 18:12:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:12:02 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:12:02 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.076s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3655f7-7198-4b3d-9ebb-6c44474af80c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3fea316-87b2-4e5f-b6c3-0591a046af95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1e3937-9d8c-4402-8dd8-2da36ebf6f25]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fea316-87b2-4e5f-b6c3-0591a046af95 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fea316-87b2-4e5f-b6c3-0591a046af95 (non-flash)
Nov 16 18:12:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:12:02 user nova-compute[75342]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fea316-87b2-4e5f-b6c3-0591a046af95 (non-flash)
Nov 16 18:12:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a44167a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519'): ({'sde'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Removing single pathed devices sde {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9a5fd-d68e-4da4-a951-e66704438b60]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0edbb52-7b65-416f-a6be-28d7ac04d253]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Flushing IO for device /dev/sde {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6376fb21-e6fb-4b99-af73-74356d43af4a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[257b4468-d3d1-483a-b5cd-e14a63ed3bbc]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8fda25-be7f-40c2-a692-18c1659758d9]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74106620-9199-41b4-8ef4-38921d62b246]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260]
Nov 16 18:12:02 user nova-compute[75342]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260] successful.
Nov 16 18:12:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5319b09-d200-417f-8566-f75526189dbc]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.538s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] <== disconnect_volume: return (539ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:12:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:12:02 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Deleting instance files /opt/stack/data/nova/instances/d4c63c32-8406-4498-b4de-8e8ecbc2a173_del
Nov 16 18:12:02 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Deletion of /opt/stack/data/nova/instances/d4c63c32-8406-4498-b4de-8e8ecbc2a173_del complete
Nov 16 18:12:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-d2a3be1a-3b90-4e8f-922b-f65d2cd44d7b req-67ae7169-10f6-4238-903f-2baaa3df02a8 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-changed-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-d2a3be1a-3b90-4e8f-922b-f65d2cd44d7b req-67ae7169-10f6-4238-903f-2baaa3df02a8 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Refreshing instance network info cache due to event network-changed-1f0e212f-0cb1-47be-b27f-90feb2b3568f. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:12:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d2a3be1a-3b90-4e8f-922b-f65d2cd44d7b req-67ae7169-10f6-4238-903f-2baaa3df02a8 service nova] Acquiring lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:12:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d2a3be1a-3b90-4e8f-922b-f65d2cd44d7b req-67ae7169-10f6-4238-903f-2baaa3df02a8 service nova] Acquired lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:12:03 user nova-compute[75342]: DEBUG nova.network.neutron [req-d2a3be1a-3b90-4e8f-922b-f65d2cd44d7b req-67ae7169-10f6-4238-903f-2baaa3df02a8 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Refreshing network info cache for port 1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:12:04 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Deleted allocations for instance d4c63c32-8406-4498-b4de-8e8ecbc2a173
Nov 16 18:12:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:04 user nova-compute[75342]: DEBUG nova.objects.instance [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lazy-loading 'numa_topology' on Instance uuid d4c63c32-8406-4498-b4de-8e8ecbc2a173 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:12:04 user nova-compute[75342]: DEBUG nova.objects.base [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Object Instance<d4c63c32-8406-4498-b4de-8e8ecbc2a173> lazy-loaded attributes: resources,numa_topology {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:12:04 user nova-compute[75342]: DEBUG nova.network.neutron [req-d2a3be1a-3b90-4e8f-922b-f65d2cd44d7b req-67ae7169-10f6-4238-903f-2baaa3df02a8 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updated VIF entry in instance network info cache for port 1f0e212f-0cb1-47be-b27f-90feb2b3568f. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:12:04 user nova-compute[75342]: DEBUG nova.network.neutron [req-d2a3be1a-3b90-4e8f-922b-f65d2cd44d7b req-67ae7169-10f6-4238-903f-2baaa3df02a8 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating instance_info_cache with network_info: [{"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": null, "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:12:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d2a3be1a-3b90-4e8f-922b-f65d2cd44d7b req-67ae7169-10f6-4238-903f-2baaa3df02a8 service nova] Releasing lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:12:04 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:12:04 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:12:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.722s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bd7a5c94-16df-4439-8d58-a111ea07ece9 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 6.378s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:12:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:12:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:32 user nova-compute[75342]: INFO nova.compute.manager [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Detaching volume ed80d9c2-3208-4679-8fd7-b350b2ab807e
Nov 16 18:12:32 user nova-compute[75342]: INFO nova.virt.block_device [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Attempting to driver detach volume ed80d9c2-3208-4679-8fd7-b350b2ab807e from mountpoint /dev/vdb
Nov 16 18:12:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Attempting to detach device vdb from instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:12:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:12:32 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:12:32 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:12:32 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:12:32 user nova-compute[75342]:   <serial>ed80d9c2-3208-4679-8fd7-b350b2ab807e</serial>
Nov 16 18:12:32 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 18:12:32 user nova-compute[75342]: </disk>
Nov 16 18:12:32 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:12:32 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully detached device vdb from instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 from the persistent domain config.
Nov 16 18:12:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:12:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:12:32 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:12:32 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:12:32 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:12:32 user nova-compute[75342]:   <serial>ed80d9c2-3208-4679-8fd7-b350b2ab807e</serial>
Nov 16 18:12:32 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 18:12:32 user nova-compute[75342]: </disk>
Nov 16 18:12:32 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:12:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:12:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "c6408c85-ed86-4b11-afa6-14f93b92492c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:35 user nova-compute[75342]: INFO nova.compute.manager [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Terminating instance
Nov 16 18:12:35 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-e008ff42-e648-4b2e-8e3d-6497354dc2aa req-23fc266a-89fc-4849-924c-0caa6426117b service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Received event network-vif-unplugged-99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e008ff42-e648-4b2e-8e3d-6497354dc2aa req-23fc266a-89fc-4849-924c-0caa6426117b service nova] Acquiring lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e008ff42-e648-4b2e-8e3d-6497354dc2aa req-23fc266a-89fc-4849-924c-0caa6426117b service nova] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e008ff42-e648-4b2e-8e3d-6497354dc2aa req-23fc266a-89fc-4849-924c-0caa6426117b service nova] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-e008ff42-e648-4b2e-8e3d-6497354dc2aa req-23fc266a-89fc-4849-924c-0caa6426117b service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] No waiting events found dispatching network-vif-unplugged-99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-e008ff42-e648-4b2e-8e3d-6497354dc2aa req-23fc266a-89fc-4849-924c-0caa6426117b service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Received event network-vif-unplugged-99579047-4ff0-4461-b833-102b0ee49c64 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:12:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Instance destroyed successfully.
Nov 16 18:12:36 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lazy-loading 'resources' on Instance uuid c6408c85-ed86-4b11-afa6-14f93b92492c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-406309213',display_name='tempest-ServersNegativeTestJSON-server-406309213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-406309213',id=18,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c366b0f382394d26a46a902606d1b860',ramdisk_id='',reservation_id='r-fgafitg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1517580992',owner_user_name='tempest-ServersNegativeTestJSON-1517580992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:03:59Z,user_data=None,user_id='520c2ec376be46aaabcc5ca1c7aa831c',uuid=c6408c85-ed86-4b11-afa6-14f93b92492c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99579047-4ff0-4461-b833-102b0ee49c64", "address": "fa:16:3e:8d:b1:25", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99579047-4f", "ovs_interfaceid": "99579047-4ff0-4461-b833-102b0ee49c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converting VIF {"id": "99579047-4ff0-4461-b833-102b0ee49c64", "address": "fa:16:3e:8d:b1:25", "network": {"id": "4e291dc4-a976-4661-8073-3d144435181d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-140403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c366b0f382394d26a46a902606d1b860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99579047-4f", "ovs_interfaceid": "99579047-4ff0-4461-b833-102b0ee49c64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:b1:25,bridge_name='br-int',has_traffic_filtering=True,id=99579047-4ff0-4461-b833-102b0ee49c64,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99579047-4f') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG os_vif [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:b1:25,bridge_name='br-int',has_traffic_filtering=True,id=99579047-4ff0-4461-b833-102b0ee49c64,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99579047-4f') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99579047-4f, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90207da5-5e69-4369-aa0a-74a07a94fb94) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:36 user nova-compute[75342]: INFO os_vif [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:b1:25,bridge_name='br-int',has_traffic_filtering=True,id=99579047-4ff0-4461-b833-102b0ee49c64,network=Network(4e291dc4-a976-4661-8073-3d144435181d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99579047-4f')
Nov 16 18:12:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Deleting instance files /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c_del
Nov 16 18:12:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Deletion of /opt/stack/data/nova/instances/c6408c85-ed86-4b11-afa6-14f93b92492c_del complete
Nov 16 18:12:36 user nova-compute[75342]: INFO nova.compute.manager [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 18:12:36 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:12:36 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:12:37 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:12:37 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Took 0.64 seconds to deallocate network for instance.
Nov 16 18:12:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:37 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:12:37 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:12:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:37 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Deleted allocations for instance c6408c85-ed86-4b11-afa6-14f93b92492c
Nov 16 18:12:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9e69468e-cfbb-4564-83a0-8f5526881622 tempest-ServersNegativeTestJSON-1517580992 tempest-ServersNegativeTestJSON-1517580992-project-member] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.123s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-a4dd0bab-6fb5-4a39-92be-9dad74cb2c7f req-b238bdfe-31e7-4671-8234-85b0330f0277 service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Received event network-vif-plugged-99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a4dd0bab-6fb5-4a39-92be-9dad74cb2c7f req-b238bdfe-31e7-4671-8234-85b0330f0277 service nova] Acquiring lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a4dd0bab-6fb5-4a39-92be-9dad74cb2c7f req-b238bdfe-31e7-4671-8234-85b0330f0277 service nova] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a4dd0bab-6fb5-4a39-92be-9dad74cb2c7f req-b238bdfe-31e7-4671-8234-85b0330f0277 service nova] Lock "c6408c85-ed86-4b11-afa6-14f93b92492c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-a4dd0bab-6fb5-4a39-92be-9dad74cb2c7f req-b238bdfe-31e7-4671-8234-85b0330f0277 service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] No waiting events found dispatching network-vif-plugged-99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:37 user nova-compute[75342]: WARNING nova.compute.manager [req-a4dd0bab-6fb5-4a39-92be-9dad74cb2c7f req-b238bdfe-31e7-4671-8234-85b0330f0277 service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Received unexpected event network-vif-plugged-99579047-4ff0-4461-b833-102b0ee49c64 for instance with vm_state deleted and task_state None.
Nov 16 18:12:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-a4dd0bab-6fb5-4a39-92be-9dad74cb2c7f req-b238bdfe-31e7-4671-8234-85b0330f0277 service nova] [instance: c6408c85-ed86-4b11-afa6-14f93b92492c] Received event network-vif-deleted-99579047-4ff0-4461-b833-102b0ee49c64 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:40 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:12:40 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:12:41 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:12:41 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:12:41 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:12:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:42 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:12:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:12:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:47 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:12:47 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7123MB free_disk=25.166019439697266GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 120e116f-a0e5-406c-9883-6f173da89100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 1ce7aa5b-319e-4167-afc8-bcacd55fd794 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 6a4d9392-83e5-4423-90ce-18283717f5df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c82d7adf-64ed-4573-9b2f-58c1daab2651 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 06eb90ec-da8e-46c1-9401-b9613ebe92c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:12:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:12:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:12:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 18:12:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:12:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:12:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:12:52 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 is timed out.
Nov 16 18:12:52 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully detached device vdb from instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 from the live domain config.
Nov 16 18:12:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVMmveyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:12:52 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:12:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ced677-d250-4de0-98e0-308d57f3332f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:12:52 user nova-compute[75342]: No targets found.
Nov 16 18:12:52 user nova-compute[75342]: iSNS:
Nov 16 18:12:52 user nova-compute[75342]: No targets found.
Nov 16 18:12:52 user nova-compute[75342]: STATIC:
Nov 16 18:12:52 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:12:52 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:52 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:52 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e
Nov 16 18:12:52 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:52 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:52 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:12:52 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:52 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:52 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183
Nov 16 18:12:52 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:52 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:52 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1
Nov 16 18:12:52 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:52 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:52 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b
Nov 16 18:12:52 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:52 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:52 user nova-compute[75342]: FIRMWARE:
Nov 16 18:12:52 user nova-compute[75342]: No targets found.
Nov 16 18:12:52 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:12:52 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:12:52 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8730cabc-e318-45c3-9ec5-c835247f1703]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[53938e75-e457-4caf-9605-61217e64cc28]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:12:53 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:12:53 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:12:53 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:12:53 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:12:53 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:12:53 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:12:53 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:12:53 user nova-compute[75342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e (non-flash)
Nov 16 18:12:53 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:12:53 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:12:53 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:12:53 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c81893f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f2985a-7700-442b-b4de-e58be0295b1d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca637c4-5dca-4217-a807-c25ca8849af1]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f29a1-6e40-4757-b5c6-9671a8d5077c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[82234aaa-2102-43b9-a1ea-ad82a435509a]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a39b07-7f9a-4075-ae42-e6f53b99e1c2]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc82ac1c-f0f9-4c5d-b4f1-d3e654fba5bd]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260]
Nov 16 18:12:53 user nova-compute[75342]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e, portal: 172.16.0.220,3260] successful.
Nov 16 18:12:53 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed80d9c2-3208-4679-8fd7-b350b2ab807e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb077ad-b309-41fa-a681-7653337f47dd]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] <== disconnect_volume: return (341ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-3cb244d1-dfe3-48d9-b372-82860568c18e req-6898e4ec-655d-43f8-ad7b-628c8e82bed4 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Received event network-changed-7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-3cb244d1-dfe3-48d9-b372-82860568c18e req-6898e4ec-655d-43f8-ad7b-628c8e82bed4 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Refreshing instance network info cache due to event network-changed-7803709a-5b87-4615-8acd-771c12899de8. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3cb244d1-dfe3-48d9-b372-82860568c18e req-6898e4ec-655d-43f8-ad7b-628c8e82bed4 service nova] Acquiring lock "refresh_cache-6a4d9392-83e5-4423-90ce-18283717f5df" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3cb244d1-dfe3-48d9-b372-82860568c18e req-6898e4ec-655d-43f8-ad7b-628c8e82bed4 service nova] Acquired lock "refresh_cache-6a4d9392-83e5-4423-90ce-18283717f5df" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:12:53 user nova-compute[75342]: DEBUG nova.network.neutron [req-3cb244d1-dfe3-48d9-b372-82860568c18e req-6898e4ec-655d-43f8-ad7b-628c8e82bed4 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Refreshing network info cache for port 7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.objects.instance [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-3cb244d1-dfe3-48d9-b372-82860568c18e req-6898e4ec-655d-43f8-ad7b-628c8e82bed4 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Updated VIF entry in instance network info cache for port 7803709a-5b87-4615-8acd-771c12899de8. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-3cb244d1-dfe3-48d9-b372-82860568c18e req-6898e4ec-655d-43f8-ad7b-628c8e82bed4 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Updating instance_info_cache with network_info: [{"id": "7803709a-5b87-4615-8acd-771c12899de8", "address": "fa:16:3e:c6:d1:d9", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7803709a-5b", "ovs_interfaceid": "7803709a-5b87-4615-8acd-771c12899de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "6a4d9392-83e5-4423-90ce-18283717f5df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "6a4d9392-83e5-4423-90ce-18283717f5df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:54 user nova-compute[75342]: INFO nova.compute.manager [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Terminating instance
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3cb244d1-dfe3-48d9-b372-82860568c18e req-6898e4ec-655d-43f8-ad7b-628c8e82bed4 service nova] Releasing lock "refresh_cache-6a4d9392-83e5-4423-90ce-18283717f5df" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c3c2d796-2046-45d7-9c42-868ef324a5d0 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.822s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-52bc5ed7-8cc0-4268-be06-7cb70e89ebaa req-9bff9fdf-e53f-4c23-a691-db230f28722d service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Received event network-vif-unplugged-7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-52bc5ed7-8cc0-4268-be06-7cb70e89ebaa req-9bff9fdf-e53f-4c23-a691-db230f28722d service nova] Acquiring lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-52bc5ed7-8cc0-4268-be06-7cb70e89ebaa req-9bff9fdf-e53f-4c23-a691-db230f28722d service nova] Lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-52bc5ed7-8cc0-4268-be06-7cb70e89ebaa req-9bff9fdf-e53f-4c23-a691-db230f28722d service nova] Lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-52bc5ed7-8cc0-4268-be06-7cb70e89ebaa req-9bff9fdf-e53f-4c23-a691-db230f28722d service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] No waiting events found dispatching network-vif-unplugged-7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-52bc5ed7-8cc0-4268-be06-7cb70e89ebaa req-9bff9fdf-e53f-4c23-a691-db230f28722d service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Received event network-vif-unplugged-7803709a-5b87-4615-8acd-771c12899de8 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eecb37f9-05a9-443b-92f3-1c682a3bba6c tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eecb37f9-05a9-443b-92f3-1c682a3bba6c tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-eecb37f9-05a9-443b-92f3-1c682a3bba6c tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-eecb37f9-05a9-443b-92f3-1c682a3bba6c tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75342) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.objects.instance [None req-eecb37f9-05a9-443b-92f3-1c682a3bba6c tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:12:54 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Instance destroyed successfully.
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.objects.instance [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'resources' on Instance uuid 6a4d9392-83e5-4423-90ce-18283717f5df {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1712771091',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1712771091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1712771091',id=30,image_ref='2982d37e-6709-4c72-8318-4dc6c531f8ef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUd788Q6xCLXGQnFtwqMjzq++0DM4XV7RVnVqlsFekJn1zfNFxn1vi/8ijA8qoWHa3gxHYc0E8tpsDtolDeyFwq45C/+0aa+pBadU3c4ysGj6cqjKgQf6td52GwIJWJ8Q==',key_name='tempest-keypair-296278280',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-t0o4gcpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-312873750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062cd6d338014493be6c40701d2a735b',uuid=6a4d9392-83e5-4423-90ce-18283717f5df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7803709a-5b87-4615-8acd-771c12899de8", "address": "fa:16:3e:c6:d1:d9", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7803709a-5b", "ovs_interfaceid": "7803709a-5b87-4615-8acd-771c12899de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "7803709a-5b87-4615-8acd-771c12899de8", "address": "fa:16:3e:c6:d1:d9", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7803709a-5b", "ovs_interfaceid": "7803709a-5b87-4615-8acd-771c12899de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d1:d9,bridge_name='br-int',has_traffic_filtering=True,id=7803709a-5b87-4615-8acd-771c12899de8,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7803709a-5b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG os_vif [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d1:d9,bridge_name='br-int',has_traffic_filtering=True,id=7803709a-5b87-4615-8acd-771c12899de8,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7803709a-5b') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7803709a-5b, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d4fcb19-f626-4a91-ab03-a2eb5b26c907) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:54 user nova-compute[75342]: INFO os_vif [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d1:d9,bridge_name='br-int',has_traffic_filtering=True,id=7803709a-5b87-4615-8acd-771c12899de8,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7803709a-5b')
Nov 16 18:12:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saLDGYnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:12:54 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:12:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef16dc5-94e4-4825-8fe3-d11a62d72dbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:12:54 user nova-compute[75342]: No targets found.
Nov 16 18:12:54 user nova-compute[75342]: iSNS:
Nov 16 18:12:54 user nova-compute[75342]: No targets found.
Nov 16 18:12:54 user nova-compute[75342]: STATIC:
Nov 16 18:12:54 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:12:54 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:54 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:54 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:12:54 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:54 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:54 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183
Nov 16 18:12:54 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:54 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:54 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1
Nov 16 18:12:54 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:54 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:54 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b
Nov 16 18:12:54 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:12:54 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:12:54 user nova-compute[75342]: FIRMWARE:
Nov 16 18:12:54 user nova-compute[75342]: No targets found.
Nov 16 18:12:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:12:54 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:12:54 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fdb217-0aaa-416c-846e-a194e7b78685]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99bdbe3-041b-4146-b212-c3f5347a2690]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:12:54 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:12:54 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:12:54 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:12:54 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:12:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:12:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:12:54 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:12:54 user nova-compute[75342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 (non-flash)
Nov 16 18:12:54 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:12:54 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:12:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6d01ba4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183'): ({'sdf'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Removing single pathed devices sdf {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e1303e-e6d3-4097-b287-65687e0aa601]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[294b5886-b8ff-4e6b-b00d-dae69ea0a333]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flushing IO for device /dev/sdf {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[47139903-da87-4af5-b1b3-e50b2bf25586]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0d9208-f495-413d-8128-2e2c7a1e70fc]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] SCSI volumes sdf have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fd83e6-3b49-4cb8-af20-f14244348c24]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[80897877-646e-4204-aab5-3a29c1702148]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183, portal: 172.16.0.220,3260]
Nov 16 18:12:55 user nova-compute[75342]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183, portal: 172.16.0.220,3260] successful.
Nov 16 18:12:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a629320-710b-47c3-bdcb-88754cc4c183 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bcab19-2ec3-4dc9-a345-b60cdc82815b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== disconnect_volume: return (381ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:12:55 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Deleting instance files /opt/stack/data/nova/instances/6a4d9392-83e5-4423-90ce-18283717f5df_del
Nov 16 18:12:55 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Deletion of /opt/stack/data/nova/instances/6a4d9392-83e5-4423-90ce-18283717f5df_del complete
Nov 16 18:12:55 user nova-compute[75342]: INFO nova.compute.manager [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-unplugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-unplugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:55 user nova-compute[75342]: WARNING nova.compute.manager [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received unexpected event network-vif-unplugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with vm_state active and task_state powering-off.
Nov 16 18:12:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:55 user nova-compute[75342]: WARNING nova.compute.manager [req-4adc498c-c268-4efa-b38e-e0c88f29c50b req-19456eb0-8769-43bd-b07d-08999bcf83b3 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received unexpected event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with vm_state active and task_state powering-off.
Nov 16 18:12:55 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance destroyed successfully.
Nov 16 18:12:55 user nova-compute[75342]: DEBUG nova.compute.manager [None req-eecb37f9-05a9-443b-92f3-1c682a3bba6c tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:12:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-eecb37f9-05a9-443b-92f3-1c682a3bba6c tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.896s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:56 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:12:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-50d144d3-dcbb-4cb2-b6eb-de54ad9f29c9 req-8964cf8a-786b-4af1-9a49-364a80d0b0ba service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Received event network-vif-deleted-7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:56 user nova-compute[75342]: INFO nova.compute.manager [req-50d144d3-dcbb-4cb2-b6eb-de54ad9f29c9 req-8964cf8a-786b-4af1-9a49-364a80d0b0ba service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Neutron deleted interface 7803709a-5b87-4615-8acd-771c12899de8; detaching it from the instance and deleting it from the info cache
Nov 16 18:12:56 user nova-compute[75342]: DEBUG nova.network.neutron [req-50d144d3-dcbb-4cb2-b6eb-de54ad9f29c9 req-8964cf8a-786b-4af1-9a49-364a80d0b0ba service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:12:56 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Took 1.08 seconds to deallocate network for instance.
Nov 16 18:12:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-50d144d3-dcbb-4cb2-b6eb-de54ad9f29c9 req-8964cf8a-786b-4af1-9a49-364a80d0b0ba service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Detach interface failed, port_id=7803709a-5b87-4615-8acd-771c12899de8, reason: Instance 6a4d9392-83e5-4423-90ce-18283717f5df could not be found. {{(pid=75342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 18:12:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-1c238b6e-2d4a-4040-be1f-fa07353d000f req-55c98e4a-4961-4950-9f8a-7b6129864f58 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Received event network-vif-plugged-7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:12:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1c238b6e-2d4a-4040-be1f-fa07353d000f req-55c98e4a-4961-4950-9f8a-7b6129864f58 service nova] Acquiring lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1c238b6e-2d4a-4040-be1f-fa07353d000f req-55c98e4a-4961-4950-9f8a-7b6129864f58 service nova] Lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1c238b6e-2d4a-4040-be1f-fa07353d000f req-55c98e4a-4961-4950-9f8a-7b6129864f58 service nova] Lock "6a4d9392-83e5-4423-90ce-18283717f5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-1c238b6e-2d4a-4040-be1f-fa07353d000f req-55c98e4a-4961-4950-9f8a-7b6129864f58 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] No waiting events found dispatching network-vif-plugged-7803709a-5b87-4615-8acd-771c12899de8 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:12:56 user nova-compute[75342]: WARNING nova.compute.manager [req-1c238b6e-2d4a-4040-be1f-fa07353d000f req-55c98e4a-4961-4950-9f8a-7b6129864f58 service nova] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Received unexpected event network-vif-plugged-7803709a-5b87-4615-8acd-771c12899de8 for instance with vm_state active and task_state deleting.
Nov 16 18:12:57 user nova-compute[75342]: INFO nova.compute.manager [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Took 0.70 seconds to detach 1 volumes for instance.
Nov 16 18:12:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 6a4d9392-83e5-4423-90ce-18283717f5df] Deleting volume: 8a629320-710b-47c3-bdcb-88754cc4c183 {{(pid=75342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 18:12:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:12:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:12:57 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:12:57 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:12:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:57 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Deleted allocations for instance 6a4d9392-83e5-4423-90ce-18283717f5df
Nov 16 18:12:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-745661b9-340c-46c0-8a39-02a0e40974a9 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "6a4d9392-83e5-4423-90ce-18283717f5df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.749s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:12:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:12:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-e3ca8dd7-818c-4ebd-9f3f-149e8f2ae367 req-22a758f9-1ca1-4ecc-b012-b1ad48e94394 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received event network-changed-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-e3ca8dd7-818c-4ebd-9f3f-149e8f2ae367 req-22a758f9-1ca1-4ecc-b012-b1ad48e94394 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Refreshing instance network info cache due to event network-changed-90788e52-2039-4374-bf9a-a77637f0752d. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:13:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e3ca8dd7-818c-4ebd-9f3f-149e8f2ae367 req-22a758f9-1ca1-4ecc-b012-b1ad48e94394 service nova] Acquiring lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e3ca8dd7-818c-4ebd-9f3f-149e8f2ae367 req-22a758f9-1ca1-4ecc-b012-b1ad48e94394 service nova] Acquired lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:00 user nova-compute[75342]: DEBUG nova.network.neutron [req-e3ca8dd7-818c-4ebd-9f3f-149e8f2ae367 req-22a758f9-1ca1-4ecc-b012-b1ad48e94394 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Refreshing network info cache for port 90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:13:00 user nova-compute[75342]: DEBUG nova.network.neutron [req-e3ca8dd7-818c-4ebd-9f3f-149e8f2ae367 req-22a758f9-1ca1-4ecc-b012-b1ad48e94394 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updated VIF entry in instance network info cache for port 90788e52-2039-4374-bf9a-a77637f0752d. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:13:00 user nova-compute[75342]: DEBUG nova.network.neutron [req-e3ca8dd7-818c-4ebd-9f3f-149e8f2ae367 req-22a758f9-1ca1-4ecc-b012-b1ad48e94394 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updating instance_info_cache with network_info: [{"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e3ca8dd7-818c-4ebd-9f3f-149e8f2ae367 req-22a758f9-1ca1-4ecc-b012-b1ad48e94394 service nova] Releasing lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Stashing vm_state: active {{(pid=75342) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:13:02 user nova-compute[75342]: INFO nova.compute.claims [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Claim successful on node user
Nov 16 18:13:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-dde02eb0-7449-4aa2-9f3b-ba225d592627 req-f19fb935-c749-4904-a3e3-5f5d1ad65d2b service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-changed-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-dde02eb0-7449-4aa2-9f3b-ba225d592627 req-f19fb935-c749-4904-a3e3-5f5d1ad65d2b service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Refreshing instance network info cache due to event network-changed-b0832714-4459-45d7-bf7f-acb458b04551. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dde02eb0-7449-4aa2-9f3b-ba225d592627 req-f19fb935-c749-4904-a3e3-5f5d1ad65d2b service nova] Acquiring lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dde02eb0-7449-4aa2-9f3b-ba225d592627 req-f19fb935-c749-4904-a3e3-5f5d1ad65d2b service nova] Acquired lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG nova.network.neutron [req-dde02eb0-7449-4aa2-9f3b-ba225d592627 req-f19fb935-c749-4904-a3e3-5f5d1ad65d2b service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Refreshing network info cache for port b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:13:02 user nova-compute[75342]: INFO nova.compute.resource_tracker [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updating resource usage from migration da0b93a3-b601-4a82-bc33-7901e61b8390
Nov 16 18:13:02 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG nova.network.neutron [req-dde02eb0-7449-4aa2-9f3b-ba225d592627 req-f19fb935-c749-4904-a3e3-5f5d1ad65d2b service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updated VIF entry in instance network info cache for port b0832714-4459-45d7-bf7f-acb458b04551. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG nova.network.neutron [req-dde02eb0-7449-4aa2-9f3b-ba225d592627 req-f19fb935-c749-4904-a3e3-5f5d1ad65d2b service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updating instance_info_cache with network_info: [{"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.666s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:02 user nova-compute[75342]: INFO nova.compute.manager [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Migrating
Nov 16 18:13:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dde02eb0-7449-4aa2-9f3b-ba225d592627 req-f19fb935-c749-4904-a3e3-5f5d1ad65d2b service nova] Releasing lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquired lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updating instance_info_cache with network_info: [{"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Releasing lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Starting migrate_disk_and_power_off {{(pid=75342) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-007ac87b-5b2e-4c64-86d7-9effcbe13044 req-b113e633-b63d-43f3-83ec-5e103aa15389 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-vif-unplugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-007ac87b-5b2e-4c64-86d7-9effcbe13044 req-b113e633-b63d-43f3-83ec-5e103aa15389 service nova] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-007ac87b-5b2e-4c64-86d7-9effcbe13044 req-b113e633-b63d-43f3-83ec-5e103aa15389 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-007ac87b-5b2e-4c64-86d7-9effcbe13044 req-b113e633-b63d-43f3-83ec-5e103aa15389 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-007ac87b-5b2e-4c64-86d7-9effcbe13044 req-b113e633-b63d-43f3-83ec-5e103aa15389 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] No waiting events found dispatching network-vif-unplugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:03 user nova-compute[75342]: WARNING nova.compute.manager [req-007ac87b-5b2e-4c64-86d7-9effcbe13044 req-b113e633-b63d-43f3-83ec-5e103aa15389 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received unexpected event network-vif-unplugged-b0832714-4459-45d7-bf7f-acb458b04551 for instance with vm_state active and task_state resize_migrating.
Nov 16 18:13:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:04 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Instance destroyed successfully.
Nov 16 18:13:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1621983513',display_name='tempest-ServerActionsTestOtherA-server-1621983513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1621983513',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU1men7gMttl3YEQ2iX5okVvx4lpe2gNM2yccK4kETnd8Mrupb252faDCsR3+7xPoiSo7c4DSoVxYlsKd1dOtU+J4xVhSH7sXMEH8ib246uK8ZL45kAm/O/eMxS5d6eeQ==',key_name='tempest-keypair-357673672',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-1dkp454h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=147d9aee-cfd9-4e78-bf35-0ac7e16f6679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-128155851-network", "vif_mac": "fa:16:3e:12:a1:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-128155851-network", "vif_mac": "fa:16:3e:12:a1:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_vif [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0832714-44, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2fe652b-5949-4ea7-b17e-c4ebafee1cdf) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:04 user nova-compute[75342]: INFO os_vif [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44')
Nov 16 18:13:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtrUQGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:13:04 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d3a7bf-26da-4b2b-81e2-fb35d6dfb9af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:13:04 user nova-compute[75342]: No targets found.
Nov 16 18:13:04 user nova-compute[75342]: iSNS:
Nov 16 18:13:04 user nova-compute[75342]: No targets found.
Nov 16 18:13:04 user nova-compute[75342]: STATIC:
Nov 16 18:13:04 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:13:04 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:13:04 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:13:04 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:13:04 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:13:04 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:13:04 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1
Nov 16 18:13:04 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:13:04 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:13:04 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b
Nov 16 18:13:04 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:13:04 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:13:04 user nova-compute[75342]: FIRMWARE:
Nov 16 18:13:04 user nova-compute[75342]: No targets found.
Nov 16 18:13:04 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:13:04 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:13:04 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfd62b2-e5e1-41d9-9813-629be0f3cfee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b8ca5e-984b-4f0d-98df-1579fdb9df27]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:04 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:04 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:04 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:04 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:04 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:04 user nova-compute[75342]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:04 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:04 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c879cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c'): ({'sdg'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Removing single pathed devices sdg {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[07174d54-ba55-44f1-98ce-c7492ef6a846]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dd2745-aa2b-422a-a8f2-ac95da02f7d4]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flushing IO for device /dev/sdg {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e149421-ab32-4f7e-827e-2220ca8a7201]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3264f18-db9d-44b6-9d82-d49fa4f6b2fd]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] SCSI volumes sdg have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26165313433383564', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e4a93adc', '/dev/disk/by-id/scsi-1SCST_BIOe4a93adc-ae14385da59b97f2') {{(pid=85570) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d44715-312d-41ab-8658-4b8019539e0c]: (4, None) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[22331314-56bf-4448-a54f-74b4cfd6332e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed68d9eb-b002-4610-9e1a-548a5d1f2a1f]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260]
Nov 16 18:13:04 user nova-compute[75342]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260] successful.
Nov 16 18:13:04 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[12825da1-4fe8-44c5-b40e-db25ff19bf7c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== disconnect_volume: return (325ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:13:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:13:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Port b0832714-4459-45d7-bf7f-acb458b04551 binding to destination host user is already ACTIVE {{(pid=75342) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 18:13:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-53242009-511b-481d-97dd-96fd04fa9922 req-fad17152-8d23-465b-8f4d-3373e4be1e5b service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-53242009-511b-481d-97dd-96fd04fa9922 req-fad17152-8d23-465b-8f4d-3373e4be1e5b service nova] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-53242009-511b-481d-97dd-96fd04fa9922 req-fad17152-8d23-465b-8f4d-3373e4be1e5b service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-53242009-511b-481d-97dd-96fd04fa9922 req-fad17152-8d23-465b-8f4d-3373e4be1e5b service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-53242009-511b-481d-97dd-96fd04fa9922 req-fad17152-8d23-465b-8f4d-3373e4be1e5b service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] No waiting events found dispatching network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:05 user nova-compute[75342]: WARNING nova.compute.manager [req-53242009-511b-481d-97dd-96fd04fa9922 req-fad17152-8d23-465b-8f4d-3373e4be1e5b service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received unexpected event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 for instance with vm_state active and task_state resize_migrated.
Nov 16 18:13:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquired lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updating instance_info_cache with network_info: [{"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Releasing lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG os_brick.utils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91662c4-575c-456f-98eb-e3453f2adb12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c57ef5-c1a0-488f-a31e-4b39f232ce01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.085s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[124713b9-a279-42ed-8252-a29736703e57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3c8f68-b2fd-405e-ad4c-f8f7373253b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:13:06 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:13:06 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bde3120-1052-45f2-8178-a562b53163af]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:13:06 user nova-compute[75342]: DEBUG os_brick.utils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:13:08 user nova-compute[75342]: INFO nova.compute.manager [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Rescuing
Nov 16 18:13:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquired lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:08 user nova-compute[75342]: DEBUG nova.network.neutron [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:13:08 user nova-compute[75342]: DEBUG nova.network.neutron [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Updating instance_info_cache with network_info: [{"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Releasing lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-0a73edb7-86c2-4712-b32e-7dbbd65633d1 req-6b33ace1-91ee-4a5b-a7a6-d2701cf60062 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-unplugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0a73edb7-86c2-4712-b32e-7dbbd65633d1 req-6b33ace1-91ee-4a5b-a7a6-d2701cf60062 service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0a73edb7-86c2-4712-b32e-7dbbd65633d1 req-6b33ace1-91ee-4a5b-a7a6-d2701cf60062 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0a73edb7-86c2-4712-b32e-7dbbd65633d1 req-6b33ace1-91ee-4a5b-a7a6-d2701cf60062 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-0a73edb7-86c2-4712-b32e-7dbbd65633d1 req-6b33ace1-91ee-4a5b-a7a6-d2701cf60062 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-unplugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:09 user nova-compute[75342]: WARNING nova.compute.manager [req-0a73edb7-86c2-4712-b32e-7dbbd65633d1 req-6b33ace1-91ee-4a5b-a7a6-d2701cf60062 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received unexpected event network-vif-unplugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with vm_state active and task_state rescuing.
Nov 16 18:13:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:09 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Instance destroyed successfully.
Nov 16 18:13:09 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Attempting a stable device rescue
Nov 16 18:13:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75342) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Instance directory exists: not creating {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 18:13:09 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Creating image(s)
Nov 16 18:13:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "/opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "/opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "/opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG nova.objects.instance [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'trusted_certs' on Instance uuid c82d7adf-64ed-4573-9b2f-58c1daab2651 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "4ef5df1c273b2ed935710b0f316176453dad41f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "4ef5df1c273b2ed935710b0f316176453dad41f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8.part --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.images [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] 31f50b27-47e8-4f3a-b93d-efe82c2fe6fc was qcow2, converting to raw {{(pid=75342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8.part /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8.converted {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-404ad4d9-c5b5-4bc7-9b29-717c57c95251 req-4c82c4dc-fcca-472c-91a8-ae954b8cefbb service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-404ad4d9-c5b5-4bc7-9b29-717c57c95251 req-4c82c4dc-fcca-472c-91a8-ae954b8cefbb service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-404ad4d9-c5b5-4bc7-9b29-717c57c95251 req-4c82c4dc-fcca-472c-91a8-ae954b8cefbb service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-404ad4d9-c5b5-4bc7-9b29-717c57c95251 req-4c82c4dc-fcca-472c-91a8-ae954b8cefbb service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-404ad4d9-c5b5-4bc7-9b29-717c57c95251 req-4c82c4dc-fcca-472c-91a8-ae954b8cefbb service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:11 user nova-compute[75342]: WARNING nova.compute.manager [req-404ad4d9-c5b5-4bc7-9b29-717c57c95251 req-4c82c4dc-fcca-472c-91a8-ae954b8cefbb service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received unexpected event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with vm_state active and task_state rescuing.
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8.part /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8.converted" returned: 0 in 0.285s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8.converted --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "4ef5df1c273b2ed935710b0f316176453dad41f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.941s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "4ef5df1c273b2ed935710b0f316176453dad41f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "4ef5df1c273b2ed935710b0f316176453dad41f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8 --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8,backing_fmt=raw /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.rescue {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8,backing_fmt=raw /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.rescue" returned: 0 in 0.051s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "4ef5df1c273b2ed935710b0f316176453dad41f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.objects.instance [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'migration_context' on Instance uuid c82d7adf-64ed-4573-9b2f-58c1daab2651 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.objects.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Object Instance<c82d7adf-64ed-4573-9b2f-58c1daab2651> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Start _get_guest_xml network_info=[{"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "vif_mac": "fa:16:3e:5f:37:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '31f50b27-47e8-4f3a-b93d-efe82c2fe6fc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '22d5406d-5f14-4ed9-be64-d3701199c56b', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCMdjWuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'c82d7adf-64ed-4573-9b2f-58c1daab2651', 'attached_at': '', 'detached_at': '', 'volume_id': '335277d4-b4fa-4f08-a27e-20f9fc786c5b', 'serial': '335277d4-b4fa-4f08-a27e-20f9fc786c5b'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.objects.instance [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'resources' on Instance uuid c82d7adf-64ed-4573-9b2f-58c1daab2651 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.objects.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Object Instance<c82d7adf-64ed-4573-9b2f-58c1daab2651> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.objects.instance [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'numa_topology' on Instance uuid c82d7adf-64ed-4573-9b2f-58c1daab2651 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.objects.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Object Instance<c82d7adf-64ed-4573-9b2f-58c1daab2651> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:11 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:13:11 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.objects.instance [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'vcpu_model' on Instance uuid c82d7adf-64ed-4573-9b2f-58c1daab2651 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Starting finish_migration {{(pid=75342) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Instance directory exists: not creating {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 18:13:11 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Creating image(s)
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Ensure instance console log exists: /opt/stack/data/nova/instances/147d9aee-cfd9-4e78-bf35-0ac7e16f6679/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Start _get_guest_xml network_info=[{"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-128155851-network", "vif_mac": "fa:16:3e:12:a1:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4e33e742-1a7d-41b2-9009-8f6f8ae0e2ea', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtrUQGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '147d9aee-cfd9-4e78-bf35-0ac7e16f6679', 'attached_at': '2023-11-16T18:13:12.000000', 'detached_at': '', 'volume_id': '62eb0bc9-da13-416b-ae9d-1bf9d700996c', 'serial': '62eb0bc9-da13-416b-ae9d-1bf9d700996c'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:13:11 user nova-compute[75342]: DEBUG nova.objects.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Object Instance<c82d7adf-64ed-4573-9b2f-58c1daab2651> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCMdjWuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:13:12 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:13:12 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:13:12 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:13:12 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtrUQGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:13:12 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8a2c56-9d34-4a60-b71b-c7e216e6182a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PCMdjWuV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 18:13:12 user nova-compute[75342]: node.name = iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b
Nov 16 18:13:12 user nova-compute[75342]: node.tpgt = -1
Nov 16 18:13:12 user nova-compute[75342]: node.startup = automatic
Nov 16 18:13:12 user nova-compute[75342]: node.leading_login = No
Nov 16 18:13:12 user nova-compute[75342]: iface.iscsi_ifacename = default
Nov 16 18:13:12 user nova-compute[75342]: iface.net_ifacename = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.ipaddress = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.prefix_len = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.hwaddress = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.transport_name = tcp
Nov 16 18:13:12 user nova-compute[75342]: iface.initiatorname = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.state = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.vlan_id = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.vlan_priority = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.vlan_state = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.iface_num = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.mtu = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.port = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.bootproto = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.subnet_mask = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.gateway = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.dhcp_alt_client_id = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.dhcp_dns = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.dhcp_learn_iqn = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.dhcp_vendor_id_state = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.dhcp_vendor_id = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.dhcp_slp_da = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.fragmentation = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.gratuitous_arp = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.incoming_forwarding = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.tos_state = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.tos = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.ttl = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.delayed_ack = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.tcp_nagle = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.tcp_wsf_state = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.tcp_wsf = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.tcp_timer_scale = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.tcp_timestamp = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.redirect = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.def_task_mgmt_timeout = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.header_digest = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.data_digest = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.immediate_data = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.initial_r2t = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.data_seq_inorder = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.data_pdu_inorder = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.erl = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.max_receive_data_len = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.first_burst_len = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.max_outstanding_r2t = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.max_burst_len = 0
Nov 16 18:13:12 user nova-compute[75342]: iface.chap_auth = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.bidi_chap = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.strict_login_compliance = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.discovery_auth = <empty>
Nov 16 18:13:12 user nova-compute[75342]: iface.discovery_logout = <empty>
Nov 16 18:13:12 user nova-compute[75342]: node.discovery_address = <empty>
Nov 16 18:13:12 user nova-compute[75342]: node.discovery_port = 0
Nov 16 18:13:12 user nova-compute[75342]: node.discovery_type = static
Nov 16 18:13:12 user nova-compute[75342]: node.session.initial_cmdsn = 0
Nov 16 18:13:12 user nova-compute[75342]: node.session.initial_login_retry_max = 8
Nov 16 18:13:12 user nova-compute[75342]: node.session.xmit_thread_priority = -20
Nov 16 18:13:12 user nova-compute[75342]: node.session.cmds_max = 128
Nov 16 18:13:12 user nova-compute[75342]: node.session.queue_depth = 32
Nov 16 18:13:12 user nova-compute[75342]: node.session.nr_sessions = 1
Nov 16 18:13:12 user nova-compute[75342]: node.session.auth.authmethod = CHAP
Nov 16 18:13:12 user nova-compute[75342]: node.session.auth.username = PCMdjWuV
Nov 16 18:13:12 user nova-compute[75342]: node.session.auth.password = ***
Nov 16 18:13:12 user nova-compute[75342]: node.session.auth.username_in = <empty>
Nov 16 18:13:12 user nova-compute[75342]: node.session.auth.password_in = <empty>
Nov 16 18:13:12 user nova-compute[75342]: node.session.auth.chap_algs = MD5
Nov 16 18:13:12 user nova-compute[75342]: node.session.timeo.replacement_timeout = 120
Nov 16 18:13:12 user nova-compute[75342]: node.session.err_timeo.abort_timeout = 15
Nov 16 18:13:12 user nova-compute[75342]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 18:13:12 user nova-compute[75342]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 18:13:12 user nova-compute[75342]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 18:13:12 user nova-compute[75342]: node.session.iscsi.FastAbort = Yes
Nov 16 18:13:12 user nova-compute[75342]: node.session.iscsi.InitialR2T = No
Nov 16 18:13:12 user nova-compute[75342]: node.session.iscsi.ImmediateData = Yes
Nov 16 18:13:12 user nova-compute[75342]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 18:13:12 user nova-compute[75342]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 18:13:12 user nova-compute[75342]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 18:13:12 user nova-compute[75342]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 18:13:12 user nova-compute[75342]: node.session.iscsi.MaxConnections = 1
Nov 16 18:13:12 user nova-compute[75342]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 18:13:12 user nova-compute[75342]: node.session.iscsi.ERL = 0
Nov 16 18:13:12 user nova-compute[75342]: node.session.scan = manual
Nov 16 18:13:12 user nova-compute[75342]: node.session.reopen_max = 0
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].address = 172.16.0.220
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].port = 3260
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].startup = manual
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].tcp.window_size = 524288
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].tcp.type_of_service = 0
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].timeo.logout_timeout = 15
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].timeo.login_timeout = 15
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].timeo.auth_timeout = 45
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].iscsi.DataDigest = None
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].iscsi.IFMarker = No
Nov 16 18:13:12 user nova-compute[75342]: node.conn[0].iscsi.OFMarker = No
Nov 16 18:13:12 user nova-compute[75342]: # END RECORD
Nov 16 18:13:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c398abe-b255-4b1f-8874-601062871810]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[013be73b-f9d0-4887-b02d-490526f3cf26]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCMdjWuV {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCMdjWuV" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9055c4d2-9ad3-45eb-8d7c-4271cb4abb2f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PCMdjWuV'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a73c91d-b765-460f-9610-6ae949f04cf7]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d7d2fc-8771-484a-a0a1-b75412c80734]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] HCTL ('39', '0', '0', 0) found on session 36 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35e04b8-4a64-4c6e-aee7-c16fbde68a79]: (4, ('0 0 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Searching for a device in session 36 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCMdjWuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.180s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '23532356263336263', 'path': '/dev/sdh'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532356263336263', 'path': '/dev/sdh'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.138s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:13:12 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:13:12 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dff9071-8f6e-40de-b7db-a6e5949237d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:13:12 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1447790317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1447790317',id=32,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:11:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-ulwm4ntp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:38Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=c82d7adf-64ed-4573-9b2f-58c1daab2651,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "vif_mac": "fa:16:3e:5f:37:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "vif_mac": "fa:16:3e:5f:37:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:37:dd,bridge_name='br-int',has_traffic_filtering=True,id=6867e53c-2663-4167-9934-1fccd82b160e,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6867e53c-26') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.objects.instance [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'pci_devices' on Instance uuid c82d7adf-64ed-4573-9b2f-58c1daab2651 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.objects.base [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Object Instance<c82d7adf-64ed-4573-9b2f-58c1daab2651> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:13:12 user nova-compute[75342]:   <uuid>c82d7adf-64ed-4573-9b2f-58c1daab2651</uuid>
Nov 16 18:13:12 user nova-compute[75342]:   <name>instance-00000020</name>
Nov 16 18:13:12 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:13:12 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:13:12 user nova-compute[75342]:   <metadata>
Nov 16 18:13:12 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:13:12 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:13:12 user nova-compute[75342]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1447790317</nova:name>
Nov 16 18:13:12 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:13:11</nova:creationTime>
Nov 16 18:13:12 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:13:12 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:13:12 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:13:12 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:13:12 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:13:12 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:13:12 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:13:12 user nova-compute[75342]:       <nova:owner>
Nov 16 18:13:12 user nova-compute[75342]:         <nova:user uuid="13beba5fa97a448fa863135a45e47cb9">tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member</nova:user>
Nov 16 18:13:12 user nova-compute[75342]:         <nova:project uuid="4542bb854a1647618ba3995c4342109a">tempest-ServerBootFromVolumeStableRescueTest-764398626</nova:project>
Nov 16 18:13:12 user nova-compute[75342]:       </nova:owner>
Nov 16 18:13:12 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:13:12 user nova-compute[75342]:       <nova:ports>
Nov 16 18:13:12 user nova-compute[75342]:         <nova:port uuid="6867e53c-2663-4167-9934-1fccd82b160e">
Nov 16 18:13:12 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 18:13:12 user nova-compute[75342]:         </nova:port>
Nov 16 18:13:12 user nova-compute[75342]:       </nova:ports>
Nov 16 18:13:12 user nova-compute[75342]:     </nova:instance>
Nov 16 18:13:12 user nova-compute[75342]:   </metadata>
Nov 16 18:13:12 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:13:12 user nova-compute[75342]:     <system>
Nov 16 18:13:12 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:13:12 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:13:12 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:13:12 user nova-compute[75342]:       <entry name="serial">c82d7adf-64ed-4573-9b2f-58c1daab2651</entry>
Nov 16 18:13:12 user nova-compute[75342]:       <entry name="uuid">c82d7adf-64ed-4573-9b2f-58c1daab2651</entry>
Nov 16 18:13:12 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:13:12 user nova-compute[75342]:     </system>
Nov 16 18:13:12 user nova-compute[75342]:   </sysinfo>
Nov 16 18:13:12 user nova-compute[75342]:   <os>
Nov 16 18:13:12 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:13:12 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:13:12 user nova-compute[75342]:   </os>
Nov 16 18:13:12 user nova-compute[75342]:   <features>
Nov 16 18:13:12 user nova-compute[75342]:     <acpi/>
Nov 16 18:13:12 user nova-compute[75342]:     <apic/>
Nov 16 18:13:12 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:13:12 user nova-compute[75342]:   </features>
Nov 16 18:13:12 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:13:12 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:13:12 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:13:12 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:13:12 user nova-compute[75342]:   </clock>
Nov 16 18:13:12 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:13:12 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:13:12 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:13:12 user nova-compute[75342]:   </cpu>
Nov 16 18:13:12 user nova-compute[75342]:   <devices>
Nov 16 18:13:12 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:13:12 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:13:12 user nova-compute[75342]:       <source dev="/dev/sdh"/>
Nov 16 18:13:12 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:13:12 user nova-compute[75342]:       <serial>335277d4-b4fa-4f08-a27e-20f9fc786c5b</serial>
Nov 16 18:13:12 user nova-compute[75342]:     </disk>
Nov 16 18:13:12 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:13:12 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:13:12 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.rescue"/>
Nov 16 18:13:12 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:13:12 user nova-compute[75342]:       <boot order="1"/>
Nov 16 18:13:12 user nova-compute[75342]:     </disk>
Nov 16 18:13:12 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:13:12 user nova-compute[75342]:       <mac address="fa:16:3e:5f:37:dd"/>
Nov 16 18:13:12 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:13:12 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:13:12 user nova-compute[75342]:       <target dev="tap6867e53c-26"/>
Nov 16 18:13:12 user nova-compute[75342]:     </interface>
Nov 16 18:13:12 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:13:12 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/console.log" append="off"/>
Nov 16 18:13:12 user nova-compute[75342]:     </serial>
Nov 16 18:13:12 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:13:12 user nova-compute[75342]:     <video>
Nov 16 18:13:12 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:13:12 user nova-compute[75342]:     </video>
Nov 16 18:13:12 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:13:12 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:13:12 user nova-compute[75342]:     </rng>
Nov 16 18:13:12 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:13:12 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:13:12 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:13:12 user nova-compute[75342]:     </memballoon>
Nov 16 18:13:12 user nova-compute[75342]:   </devices>
Nov 16 18:13:12 user nova-compute[75342]: </domain>
Nov 16 18:13:12 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce50b58-df2f-4e22-83b7-9177e4da5b7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c] added
Nov 16 18:13:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Instance destroyed successfully.
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c21dc53-eacb-44b6-af3c-a52acc5812ca]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b920cced-3cef-43ad-899d-beb2ff2e3b61]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtrUQGuB {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtrUQGuB" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4640bc-9318-46e1-bc69-601e29f3c59f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FtrUQGuB'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] No VIF found with MAC fa:16:3e:5f:37:dd, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e44a98-9eb4-41ea-a578-21bc95e0f3c9]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b25423-3736-4f90-9971-ed944092ec70]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0828ea41-3490-4022-bec5-04883c8679ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260]
Nov 16 18:13:12 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260] successful.
Nov 16 18:13:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead0b2c1-5aa3-4687-8f31-33093c929007]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b704dcb4-5383-449c-9bb9-994f41c91dc7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:12 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b826b61e-ef6b-4041-9add-fbce27aff5aa]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:13:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtrUQGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '26165313433383564', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165313433383564', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1621983513',display_name='tempest-ServerActionsTestOtherA-server-1621983513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1621983513',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU1men7gMttl3YEQ2iX5okVvx4lpe2gNM2yccK4kETnd8Mrupb252faDCsR3+7xPoiSo7c4DSoVxYlsKd1dOtU+J4xVhSH7sXMEH8ib246uK8ZL45kAm/O/eMxS5d6eeQ==',key_name='tempest-keypair-357673672',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-1dkp454h',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=147d9aee-cfd9-4e78-bf35-0ac7e16f6679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-128155851-network", "vif_mac": "fa:16:3e:12:a1:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-128155851-network", "vif_mac": "fa:16:3e:12:a1:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:13:13 user nova-compute[75342]:   <uuid>147d9aee-cfd9-4e78-bf35-0ac7e16f6679</uuid>
Nov 16 18:13:13 user nova-compute[75342]:   <name>instance-0000001f</name>
Nov 16 18:13:13 user nova-compute[75342]:   <memory>2097152</memory>
Nov 16 18:13:13 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:13:13 user nova-compute[75342]:   <metadata>
Nov 16 18:13:13 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:13:13 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:13:13 user nova-compute[75342]:       <nova:name>tempest-ServerActionsTestOtherA-server-1621983513</nova:name>
Nov 16 18:13:13 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:13:12</nova:creationTime>
Nov 16 18:13:13 user nova-compute[75342]:       <nova:flavor name="m1.small">
Nov 16 18:13:13 user nova-compute[75342]:         <nova:memory>2048</nova:memory>
Nov 16 18:13:13 user nova-compute[75342]:         <nova:disk>20</nova:disk>
Nov 16 18:13:13 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:13:13 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:13:13 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:13:13 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:13:13 user nova-compute[75342]:       <nova:owner>
Nov 16 18:13:13 user nova-compute[75342]:         <nova:user uuid="1794b9bef4ad42e6aab088f3ef90dba2">tempest-ServerActionsTestOtherA-1650562087-project-member</nova:user>
Nov 16 18:13:13 user nova-compute[75342]:         <nova:project uuid="c78cae892fff433eb216caff3a127a64">tempest-ServerActionsTestOtherA-1650562087</nova:project>
Nov 16 18:13:13 user nova-compute[75342]:       </nova:owner>
Nov 16 18:13:13 user nova-compute[75342]:       <nova:ports>
Nov 16 18:13:13 user nova-compute[75342]:         <nova:port uuid="b0832714-4459-45d7-bf7f-acb458b04551">
Nov 16 18:13:13 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 18:13:13 user nova-compute[75342]:         </nova:port>
Nov 16 18:13:13 user nova-compute[75342]:       </nova:ports>
Nov 16 18:13:13 user nova-compute[75342]:     </nova:instance>
Nov 16 18:13:13 user nova-compute[75342]:   </metadata>
Nov 16 18:13:13 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:13:13 user nova-compute[75342]:     <system>
Nov 16 18:13:13 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:13:13 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:13:13 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:13:13 user nova-compute[75342]:       <entry name="serial">147d9aee-cfd9-4e78-bf35-0ac7e16f6679</entry>
Nov 16 18:13:13 user nova-compute[75342]:       <entry name="uuid">147d9aee-cfd9-4e78-bf35-0ac7e16f6679</entry>
Nov 16 18:13:13 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:13:13 user nova-compute[75342]:     </system>
Nov 16 18:13:13 user nova-compute[75342]:   </sysinfo>
Nov 16 18:13:13 user nova-compute[75342]:   <os>
Nov 16 18:13:13 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:13:13 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:13:13 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:13:13 user nova-compute[75342]:   </os>
Nov 16 18:13:13 user nova-compute[75342]:   <features>
Nov 16 18:13:13 user nova-compute[75342]:     <acpi/>
Nov 16 18:13:13 user nova-compute[75342]:     <apic/>
Nov 16 18:13:13 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:13:13 user nova-compute[75342]:   </features>
Nov 16 18:13:13 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:13:13 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:13:13 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:13:13 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:13:13 user nova-compute[75342]:   </clock>
Nov 16 18:13:13 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:13:13 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:13:13 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:13:13 user nova-compute[75342]:   </cpu>
Nov 16 18:13:13 user nova-compute[75342]:   <devices>
Nov 16 18:13:13 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:13:13 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:13:13 user nova-compute[75342]:       <source dev="/dev/sdb"/>
Nov 16 18:13:13 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:13:13 user nova-compute[75342]:       <serial>62eb0bc9-da13-416b-ae9d-1bf9d700996c</serial>
Nov 16 18:13:13 user nova-compute[75342]:     </disk>
Nov 16 18:13:13 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:13:13 user nova-compute[75342]:       <mac address="fa:16:3e:12:a1:d8"/>
Nov 16 18:13:13 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:13:13 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:13:13 user nova-compute[75342]:       <target dev="tapb0832714-44"/>
Nov 16 18:13:13 user nova-compute[75342]:     </interface>
Nov 16 18:13:13 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:13:13 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/147d9aee-cfd9-4e78-bf35-0ac7e16f6679/console.log" append="off"/>
Nov 16 18:13:13 user nova-compute[75342]:     </serial>
Nov 16 18:13:13 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:13:13 user nova-compute[75342]:     <video>
Nov 16 18:13:13 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:13:13 user nova-compute[75342]:     </video>
Nov 16 18:13:13 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:13:13 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:13:13 user nova-compute[75342]:     </rng>
Nov 16 18:13:13 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:13:13 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:13:13 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:13:13 user nova-compute[75342]:     </memballoon>
Nov 16 18:13:13 user nova-compute[75342]:   </devices>
Nov 16 18:13:13 user nova-compute[75342]: </domain>
Nov 16 18:13:13 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1621983513',display_name='tempest-ServerActionsTestOtherA-server-1621983513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1621983513',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU1men7gMttl3YEQ2iX5okVvx4lpe2gNM2yccK4kETnd8Mrupb252faDCsR3+7xPoiSo7c4DSoVxYlsKd1dOtU+J4xVhSH7sXMEH8ib246uK8ZL45kAm/O/eMxS5d6eeQ==',key_name='tempest-keypair-357673672',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-1dkp454h',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=147d9aee-cfd9-4e78-bf35-0ac7e16f6679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-128155851-network", "vif_mac": "fa:16:3e:12:a1:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-128155851-network", "vif_mac": "fa:16:3e:12:a1:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG os_vif [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08dbfe11-7e5d-59d4-b0e5-7f9c984557d2', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0832714-44, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0832714-44, col_values=(('qos', UUID('5c1ffda0-a25a-4abd-a18e-a560ecc2fe9e')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0832714-44, col_values=(('external_ids', {'iface-id': 'b0832714-4459-45d7-bf7f-acb458b04551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:a1:d8', 'vm-uuid': '147d9aee-cfd9-4e78-bf35-0ac7e16f6679'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:13 user nova-compute[75342]: INFO os_vif [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44')
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] No VIF found with MAC fa:16:3e:12:a1:d8, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-9603afff-a45f-400e-8160-e6f502afc012 req-2367a79f-b379-4f8c-89a4-51acd46ff8b6 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9603afff-a45f-400e-8160-e6f502afc012 req-2367a79f-b379-4f8c-89a4-51acd46ff8b6 service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9603afff-a45f-400e-8160-e6f502afc012 req-2367a79f-b379-4f8c-89a4-51acd46ff8b6 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9603afff-a45f-400e-8160-e6f502afc012 req-2367a79f-b379-4f8c-89a4-51acd46ff8b6 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-9603afff-a45f-400e-8160-e6f502afc012 req-2367a79f-b379-4f8c-89a4-51acd46ff8b6 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:13 user nova-compute[75342]: WARNING nova.compute.manager [req-9603afff-a45f-400e-8160-e6f502afc012 req-2367a79f-b379-4f8c-89a4-51acd46ff8b6 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received unexpected event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with vm_state active and task_state rescuing.
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-0fb8baa3-6f59-4473-8ca9-5b3fb89c6584 req-580e4530-8d09-4727-8be5-3014c8d46d78 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0fb8baa3-6f59-4473-8ca9-5b3fb89c6584 req-580e4530-8d09-4727-8be5-3014c8d46d78 service nova] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0fb8baa3-6f59-4473-8ca9-5b3fb89c6584 req-580e4530-8d09-4727-8be5-3014c8d46d78 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0fb8baa3-6f59-4473-8ca9-5b3fb89c6584 req-580e4530-8d09-4727-8be5-3014c8d46d78 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-0fb8baa3-6f59-4473-8ca9-5b3fb89c6584 req-580e4530-8d09-4727-8be5-3014c8d46d78 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] No waiting events found dispatching network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:15 user nova-compute[75342]: WARNING nova.compute.manager [req-0fb8baa3-6f59-4473-8ca9-5b3fb89c6584 req-580e4530-8d09-4727-8be5-3014c8d46d78 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received unexpected event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 for instance with vm_state active and task_state resize_finish.
Nov 16 18:13:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-a691ef2b-0fe2-4ef3-901f-fe2964c71bd9 req-760c5b15-d34a-44fb-8521-a1e17af14205 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a691ef2b-0fe2-4ef3-901f-fe2964c71bd9 req-760c5b15-d34a-44fb-8521-a1e17af14205 service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a691ef2b-0fe2-4ef3-901f-fe2964c71bd9 req-760c5b15-d34a-44fb-8521-a1e17af14205 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a691ef2b-0fe2-4ef3-901f-fe2964c71bd9 req-760c5b15-d34a-44fb-8521-a1e17af14205 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-a691ef2b-0fe2-4ef3-901f-fe2964c71bd9 req-760c5b15-d34a-44fb-8521-a1e17af14205 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:15 user nova-compute[75342]: WARNING nova.compute.manager [req-a691ef2b-0fe2-4ef3-901f-fe2964c71bd9 req-760c5b15-d34a-44fb-8521-a1e17af14205 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received unexpected event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with vm_state active and task_state rescuing.
Nov 16 18:13:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-34387d2a-f86c-4d54-b5a0-b596dd6e7fc5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:13:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:13:17 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Instance running successfully.
Nov 16 18:13:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Failed to set time: agent not configured {{(pid=75342) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 18:13:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c7a777d-e38e-4f94-8f34-f72f5391df5d tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] finish_migration finished successfully. {{(pid=75342) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 18:13:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-88b4230d-d504-4de8-8c6b-c246ce5182d5 req-91173c24-c000-488f-864a-b17285246549 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-88b4230d-d504-4de8-8c6b-c246ce5182d5 req-91173c24-c000-488f-864a-b17285246549 service nova] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-88b4230d-d504-4de8-8c6b-c246ce5182d5 req-91173c24-c000-488f-864a-b17285246549 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-88b4230d-d504-4de8-8c6b-c246ce5182d5 req-91173c24-c000-488f-864a-b17285246549 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-88b4230d-d504-4de8-8c6b-c246ce5182d5 req-91173c24-c000-488f-864a-b17285246549 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] No waiting events found dispatching network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:17 user nova-compute[75342]: WARNING nova.compute.manager [req-88b4230d-d504-4de8-8c6b-c246ce5182d5 req-91173c24-c000-488f-864a-b17285246549 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received unexpected event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 for instance with vm_state resized and task_state None.
Nov 16 18:13:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-64e43366-ebb8-46eb-b172-80a3401d55ac req-d4f46f64-983b-4d66-a045-6e7c37895bd6 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-changed-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-64e43366-ebb8-46eb-b172-80a3401d55ac req-d4f46f64-983b-4d66-a045-6e7c37895bd6 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Refreshing instance network info cache due to event network-changed-a81da486-f0aa-446c-8682-d37aea664738. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:13:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-64e43366-ebb8-46eb-b172-80a3401d55ac req-d4f46f64-983b-4d66-a045-6e7c37895bd6 service nova] Acquiring lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-64e43366-ebb8-46eb-b172-80a3401d55ac req-d4f46f64-983b-4d66-a045-6e7c37895bd6 service nova] Acquired lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:17 user nova-compute[75342]: DEBUG nova.network.neutron [req-64e43366-ebb8-46eb-b172-80a3401d55ac req-d4f46f64-983b-4d66-a045-6e7c37895bd6 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Refreshing network info cache for port a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:13:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:18 user nova-compute[75342]: DEBUG nova.network.neutron [req-64e43366-ebb8-46eb-b172-80a3401d55ac req-d4f46f64-983b-4d66-a045-6e7c37895bd6 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updated VIF entry in instance network info cache for port a81da486-f0aa-446c-8682-d37aea664738. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:13:18 user nova-compute[75342]: DEBUG nova.network.neutron [req-64e43366-ebb8-46eb-b172-80a3401d55ac req-d4f46f64-983b-4d66-a045-6e7c37895bd6 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updating instance_info_cache with network_info: [{"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-64e43366-ebb8-46eb-b172-80a3401d55ac req-d4f46f64-983b-4d66-a045-6e7c37895bd6 service nova] Releasing lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:21 user nova-compute[75342]: INFO nova.compute.manager [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Shelving
Nov 16 18:13:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa309dab-433f-47be-a385-881ebefa82db req-72195b2e-b187-4be9-a9e3-b3a562b2329e service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-vif-unplugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa309dab-433f-47be-a385-881ebefa82db req-72195b2e-b187-4be9-a9e3-b3a562b2329e service nova] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa309dab-433f-47be-a385-881ebefa82db req-72195b2e-b187-4be9-a9e3-b3a562b2329e service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-aa309dab-433f-47be-a385-881ebefa82db req-72195b2e-b187-4be9-a9e3-b3a562b2329e service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-aa309dab-433f-47be-a385-881ebefa82db req-72195b2e-b187-4be9-a9e3-b3a562b2329e service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] No waiting events found dispatching network-vif-unplugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:22 user nova-compute[75342]: WARNING nova.compute.manager [req-aa309dab-433f-47be-a385-881ebefa82db req-72195b2e-b187-4be9-a9e3-b3a562b2329e service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received unexpected event network-vif-unplugged-a81da486-f0aa-446c-8682-d37aea664738 for instance with vm_state active and task_state shelving.
Nov 16 18:13:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:22 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Instance destroyed successfully.
Nov 16 18:13:22 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Beginning cold snapshot process
Nov 16 18:13:22 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:13:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk /opt/stack/data/nova/instances/snapshots/tmpeckbo1_0/96b69cdaa477450186ba6040cd6127a2 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-db69dd74-4591-4ea2-9d9c-e0bd6c46e970 req-bbec971c-ba61-40fb-93c0-e3adcd346dd9 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-changed-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-db69dd74-4591-4ea2-9d9c-e0bd6c46e970 req-bbec971c-ba61-40fb-93c0-e3adcd346dd9 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Refreshing instance network info cache due to event network-changed-01f59d58-7783-45da-bc6c-5834a6924118. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:13:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-db69dd74-4591-4ea2-9d9c-e0bd6c46e970 req-bbec971c-ba61-40fb-93c0-e3adcd346dd9 service nova] Acquiring lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-db69dd74-4591-4ea2-9d9c-e0bd6c46e970 req-bbec971c-ba61-40fb-93c0-e3adcd346dd9 service nova] Acquired lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:23 user nova-compute[75342]: DEBUG nova.network.neutron [req-db69dd74-4591-4ea2-9d9c-e0bd6c46e970 req-bbec971c-ba61-40fb-93c0-e3adcd346dd9 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Refreshing network info cache for port 01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:13:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk /opt/stack/data/nova/instances/snapshots/tmpeckbo1_0/96b69cdaa477450186ba6040cd6127a2" returned: 0 in 0.852s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:23 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Snapshot extracted, beginning image upload
Nov 16 18:13:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:23 user nova-compute[75342]: DEBUG nova.objects.instance [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'flavor' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:24 user nova-compute[75342]: INFO nova.compute.manager [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Attaching volume 524806f7-7999-4344-afe4-1d35485bebc8 to /dev/vdb
Nov 16 18:13:24 user nova-compute[75342]: DEBUG nova.network.neutron [req-db69dd74-4591-4ea2-9d9c-e0bd6c46e970 req-bbec971c-ba61-40fb-93c0-e3adcd346dd9 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updated VIF entry in instance network info cache for port 01f59d58-7783-45da-bc6c-5834a6924118. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG nova.network.neutron [req-db69dd74-4591-4ea2-9d9c-e0bd6c46e970 req-bbec971c-ba61-40fb-93c0-e3adcd346dd9 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updating instance_info_cache with network_info: [{"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-db69dd74-4591-4ea2-9d9c-e0bd6c46e970 req-bbec971c-ba61-40fb-93c0-e3adcd346dd9 service nova] Releasing lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG os_brick.utils [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4100b27-0e75-4427-867b-bb26b51079fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[63826a4b-f255-4bb2-bc53-ecfdef3f626f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[583975fc-52b0-4654-ab30-29135c8a9b48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b044e8f4-f00a-48d6-b38a-692f3f7282a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:13:24 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[01522d83-b160-4011-945d-e58414ac9e9c]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG os_brick.utils [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updating existing volume attachment record: f1803ac1-a67d-44f1-8b58-efffa8bba6b7 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-26415ce9-27e7-4ae3-b31d-f35c60517f5b req-420e1cbc-b1b9-4d22-8a0a-45a2d3551276 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-26415ce9-27e7-4ae3-b31d-f35c60517f5b req-420e1cbc-b1b9-4d22-8a0a-45a2d3551276 service nova] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-26415ce9-27e7-4ae3-b31d-f35c60517f5b req-420e1cbc-b1b9-4d22-8a0a-45a2d3551276 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-26415ce9-27e7-4ae3-b31d-f35c60517f5b req-420e1cbc-b1b9-4d22-8a0a-45a2d3551276 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-26415ce9-27e7-4ae3-b31d-f35c60517f5b req-420e1cbc-b1b9-4d22-8a0a-45a2d3551276 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] No waiting events found dispatching network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:24 user nova-compute[75342]: WARNING nova.compute.manager [req-26415ce9-27e7-4ae3-b31d-f35c60517f5b req-420e1cbc-b1b9-4d22-8a0a-45a2d3551276 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received unexpected event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 18:13:26 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Snapshot image upload complete
Nov 16 18:13:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:13:26 user nova-compute[75342]: INFO nova.compute.manager [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Shelve offloading
Nov 16 18:13:26 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Instance destroyed successfully.
Nov 16 18:13:26 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:13:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquired lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:26 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:13:26 user nova-compute[75342]: DEBUG nova.network.neutron [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updating instance_info_cache with network_info: [{"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Releasing lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Instance destroyed successfully.
Nov 16 18:13:27 user nova-compute[75342]: DEBUG nova.objects.instance [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'resources' on Instance uuid 06eb90ec-da8e-46c1-9401-b9613ebe92c0 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1820588361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1820588361',id=33,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP5DtxWdGwxM/d1hsyt2mQTYeKWcOFtoSPQ5b4E2L6TQIIA18JIlNqXNV7CVub0oAkDX93T4/krIINufmG3TeA/Jah0HxbBoOZgsCK8a8QOI2ExAuLhoZN2jkOUV6V43w==',key_name='tempest-keypair-1106578881',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-wuca4hmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member',shelved_at='2023-11-16T18:13:26.307380',shelved_host='user',shelved_image_id='4eb95d15-8d54-46cb-95b4-c8b41a896665'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:13:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=06eb90ec-da8e-46c1-9401-b9613ebe92c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG os_vif [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa81da486-f0, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG nova.compute.manager [req-e4cf0a9e-1867-4b08-86c6-f6155bd23731 req-7ac7c4f8-2678-4c94-8561-fdfea489b8e9 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-changed-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG nova.compute.manager [req-e4cf0a9e-1867-4b08-86c6-f6155bd23731 req-7ac7c4f8-2678-4c94-8561-fdfea489b8e9 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Refreshing instance network info cache due to event network-changed-a81da486-f0aa-446c-8682-d37aea664738. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e4cf0a9e-1867-4b08-86c6-f6155bd23731 req-7ac7c4f8-2678-4c94-8561-fdfea489b8e9 service nova] Acquiring lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e4cf0a9e-1867-4b08-86c6-f6155bd23731 req-7ac7c4f8-2678-4c94-8561-fdfea489b8e9 service nova] Acquired lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG nova.network.neutron [req-e4cf0a9e-1867-4b08-86c6-f6155bd23731 req-7ac7c4f8-2678-4c94-8561-fdfea489b8e9 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Refreshing network info cache for port a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdbf2c92-2f12-43a8-9c4f-9a8aff3ae5f7) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:13:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:27 user nova-compute[75342]: INFO os_vif [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0')
Nov 16 18:13:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Deleting instance files /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0_del
Nov 16 18:13:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Deletion of /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0_del complete
Nov 16 18:13:28 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Deleted allocations for instance 06eb90ec-da8e-46c1-9401-b9613ebe92c0
Nov 16 18:13:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG nova.objects.instance [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'numa_topology' on Instance uuid 06eb90ec-da8e-46c1-9401-b9613ebe92c0 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG nova.objects.base [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Object Instance<06eb90ec-da8e-46c1-9401-b9613ebe92c0> lazy-loaded attributes: resources,numa_topology {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG nova.network.neutron [req-e4cf0a9e-1867-4b08-86c6-f6155bd23731 req-7ac7c4f8-2678-4c94-8561-fdfea489b8e9 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updated VIF entry in instance network info cache for port a81da486-f0aa-446c-8682-d37aea664738. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG nova.network.neutron [req-e4cf0a9e-1867-4b08-86c6-f6155bd23731 req-7ac7c4f8-2678-4c94-8561-fdfea489b8e9 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updating instance_info_cache with network_info: [{"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa81da486-f0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e4cf0a9e-1867-4b08-86c6-f6155bd23731 req-7ac7c4f8-2678-4c94-8561-fdfea489b8e9 service nova] Releasing lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba90967c-f0ee-4d30-b1e1-3a339d6b90ff tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.838s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUASrjJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:13:29 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:13:29 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:13:29 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8164aa-8fe8-4f25-9c1b-c00ad4ff1001]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:13:29 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f3cefe-3dac-48dd-b8cd-b12bd4135ba1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8] added
Nov 16 18:13:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[362c2637-dd30-41c6-9b6b-11ea135f09f1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f263f51c-da43-4da8-b3c4-e430e9609840]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zUASrjJd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zUASrjJd" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b2e5ab-4827-4090-8c77-4912d289e9b3]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zUASrjJd'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee54920-5c7e-4aa5-9817-4874f789fa1b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cbee0f-8298-4aae-b471-5699e5ba0287]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:29 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:29 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:29 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:29 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:29 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:29 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[241c340a-2e2d-4d7e-992b-f2aa6dd56d89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8, portal: 172.16.0.220,3260]
Nov 16 18:13:29 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8, portal: 172.16.0.220,3260] successful.
Nov 16 18:13:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd324ab-8fd3-4015-9f43-d965750fc974]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc02cc8-f018-4c85-a513-ea2e8b1a9897]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:30 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:30 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:30 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:30 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:13:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:30 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:30 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:30 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:30 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:13:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[75130048-3a9c-4fe5-be64-25ae1c1d1acc]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:13:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUASrjJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:13:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:13:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23762366462633935', 'path': '/dev/sde'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:13:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762366462633935', 'path': '/dev/sde'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:13:31 user nova-compute[75342]: DEBUG nova.objects.instance [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'flavor' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:13:31 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:13:31 user nova-compute[75342]:   <source dev="/dev/sde"/>
Nov 16 18:13:31 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:13:31 user nova-compute[75342]:   <serial>524806f7-7999-4344-afe4-1d35485bebc8</serial>
Nov 16 18:13:31 user nova-compute[75342]: </disk>
Nov 16 18:13:31 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:13:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:13:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:13:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No VIF found with MAC fa:16:3e:1e:4f:cc, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:13:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6c254656-4b34-474a-8660-96d8fb8b757d tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.604s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:33 user nova-compute[75342]: INFO nova.compute.manager [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Rescuing
Nov 16 18:13:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquired lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:33 user nova-compute[75342]: DEBUG nova.network.neutron [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:13:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:33 user nova-compute[75342]: DEBUG nova.network.neutron [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updating instance_info_cache with network_info: [{"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Releasing lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-c307d62e-c9ba-4f74-96c4-b23109c25c66 req-737c4334-7c17-4385-a278-cb167ee2545a service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c307d62e-c9ba-4f74-96c4-b23109c25c66 req-737c4334-7c17-4385-a278-cb167ee2545a service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c307d62e-c9ba-4f74-96c4-b23109c25c66 req-737c4334-7c17-4385-a278-cb167ee2545a service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c307d62e-c9ba-4f74-96c4-b23109c25c66 req-737c4334-7c17-4385-a278-cb167ee2545a service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-c307d62e-c9ba-4f74-96c4-b23109c25c66 req-737c4334-7c17-4385-a278-cb167ee2545a service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:34 user nova-compute[75342]: WARNING nova.compute.manager [req-c307d62e-c9ba-4f74-96c4-b23109c25c66 req-737c4334-7c17-4385-a278-cb167ee2545a service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state active and task_state rescuing.
Nov 16 18:13:34 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Instance destroyed successfully.
Nov 16 18:13:34 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Attempting rescue
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75342) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Instance directory exists: not creating {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 18:13:34 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Creating image(s)
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "/opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "/opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.201s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.rescue {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.rescue" returned: 0 in 0.062s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'migration_context' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.objects.base [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Start _get_guest_xml network_info=[{"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "vif_mac": "fa:16:3e:1e:4f:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'resources' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.objects.base [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'numa_topology' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.objects.base [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:34 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:13:34 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.objects.base [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-312026651',display_name='tempest-ServerRescueNegativeTestJSON-server-312026651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-312026651',id=34,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA26q3PLEG430qQKUG7KVHVR1G1xH6/5zkOYUuj6Uf9b3zgk5ntrZk6vFHpepH7LfPKXhlO8sApShsL0bdYrqRWyzpKEe2UwkxAz2JacyKrsu43gCO+MYiAcuvjbmWvpKg==',key_name='tempest-keypair-614923427',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:11:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-gli1u0lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "vif_mac": "fa:16:3e:1e:4f:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "vif_mac": "fa:16:3e:1e:4f:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:cc,bridge_name='br-int',has_traffic_filtering=True,id=01f59d58-7783-45da-bc6c-5834a6924118,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f59d58-77') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:13:34 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'pci_devices' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:35 user nova-compute[75342]: DEBUG nova.objects.base [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Object Instance<9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:13:35 user nova-compute[75342]:   <uuid>9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c</uuid>
Nov 16 18:13:35 user nova-compute[75342]:   <name>instance-00000022</name>
Nov 16 18:13:35 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:13:35 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:13:35 user nova-compute[75342]:   <metadata>
Nov 16 18:13:35 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:13:35 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:13:35 user nova-compute[75342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-312026651</nova:name>
Nov 16 18:13:35 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:13:34</nova:creationTime>
Nov 16 18:13:35 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:13:35 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:13:35 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:13:35 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:13:35 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:13:35 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:13:35 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:13:35 user nova-compute[75342]:       <nova:owner>
Nov 16 18:13:35 user nova-compute[75342]:         <nova:user uuid="0697a15cd0054cef90459da99a3fd8ec">tempest-ServerRescueNegativeTestJSON-935902109-project-member</nova:user>
Nov 16 18:13:35 user nova-compute[75342]:         <nova:project uuid="02d87f343b6e4dbead83e037619ae49c">tempest-ServerRescueNegativeTestJSON-935902109</nova:project>
Nov 16 18:13:35 user nova-compute[75342]:       </nova:owner>
Nov 16 18:13:35 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:13:35 user nova-compute[75342]:       <nova:ports>
Nov 16 18:13:35 user nova-compute[75342]:         <nova:port uuid="01f59d58-7783-45da-bc6c-5834a6924118">
Nov 16 18:13:35 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 18:13:35 user nova-compute[75342]:         </nova:port>
Nov 16 18:13:35 user nova-compute[75342]:       </nova:ports>
Nov 16 18:13:35 user nova-compute[75342]:     </nova:instance>
Nov 16 18:13:35 user nova-compute[75342]:   </metadata>
Nov 16 18:13:35 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:13:35 user nova-compute[75342]:     <system>
Nov 16 18:13:35 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:13:35 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:13:35 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:13:35 user nova-compute[75342]:       <entry name="serial">9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c</entry>
Nov 16 18:13:35 user nova-compute[75342]:       <entry name="uuid">9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c</entry>
Nov 16 18:13:35 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:13:35 user nova-compute[75342]:     </system>
Nov 16 18:13:35 user nova-compute[75342]:   </sysinfo>
Nov 16 18:13:35 user nova-compute[75342]:   <os>
Nov 16 18:13:35 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:13:35 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:13:35 user nova-compute[75342]:   </os>
Nov 16 18:13:35 user nova-compute[75342]:   <features>
Nov 16 18:13:35 user nova-compute[75342]:     <acpi/>
Nov 16 18:13:35 user nova-compute[75342]:     <apic/>
Nov 16 18:13:35 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:13:35 user nova-compute[75342]:   </features>
Nov 16 18:13:35 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:13:35 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:13:35 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:13:35 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:13:35 user nova-compute[75342]:   </clock>
Nov 16 18:13:35 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:13:35 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:13:35 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:13:35 user nova-compute[75342]:   </cpu>
Nov 16 18:13:35 user nova-compute[75342]:   <devices>
Nov 16 18:13:35 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:13:35 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:13:35 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.rescue"/>
Nov 16 18:13:35 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:13:35 user nova-compute[75342]:     </disk>
Nov 16 18:13:35 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:13:35 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:13:35 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk"/>
Nov 16 18:13:35 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:13:35 user nova-compute[75342]:     </disk>
Nov 16 18:13:35 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:13:35 user nova-compute[75342]:       <mac address="fa:16:3e:1e:4f:cc"/>
Nov 16 18:13:35 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:13:35 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:13:35 user nova-compute[75342]:       <target dev="tap01f59d58-77"/>
Nov 16 18:13:35 user nova-compute[75342]:     </interface>
Nov 16 18:13:35 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:13:35 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/console.log" append="off"/>
Nov 16 18:13:35 user nova-compute[75342]:     </serial>
Nov 16 18:13:35 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:13:35 user nova-compute[75342]:     <video>
Nov 16 18:13:35 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:13:35 user nova-compute[75342]:     </video>
Nov 16 18:13:35 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:13:35 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:13:35 user nova-compute[75342]:     </rng>
Nov 16 18:13:35 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:13:35 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:13:35 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:13:35 user nova-compute[75342]:     </memballoon>
Nov 16 18:13:35 user nova-compute[75342]:   </devices>
Nov 16 18:13:35 user nova-compute[75342]: </domain>
Nov 16 18:13:35 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:13:35 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Instance destroyed successfully.
Nov 16 18:13:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:13:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:13:35 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] No VIF found with MAC fa:16:3e:1e:4f:cc, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:13:36 user nova-compute[75342]: DEBUG nova.compute.manager [req-4b1865cc-458f-465e-adde-6b39e61ed036 req-ee7d588d-71fd-47c9-bd6b-305b1dece60d service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4b1865cc-458f-465e-adde-6b39e61ed036 req-ee7d588d-71fd-47c9-bd6b-305b1dece60d service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4b1865cc-458f-465e-adde-6b39e61ed036 req-ee7d588d-71fd-47c9-bd6b-305b1dece60d service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4b1865cc-458f-465e-adde-6b39e61ed036 req-ee7d588d-71fd-47c9-bd6b-305b1dece60d service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:36 user nova-compute[75342]: DEBUG nova.compute.manager [req-4b1865cc-458f-465e-adde-6b39e61ed036 req-ee7d588d-71fd-47c9-bd6b-305b1dece60d service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:36 user nova-compute[75342]: WARNING nova.compute.manager [req-4b1865cc-458f-465e-adde-6b39e61ed036 req-ee7d588d-71fd-47c9-bd6b-305b1dece60d service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state active and task_state rescuing.
Nov 16 18:13:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:38 user nova-compute[75342]: WARNING nova.compute.manager [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state active and task_state rescuing.
Nov 16 18:13:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:38 user nova-compute[75342]: WARNING nova.compute.manager [req-9be278b2-17d2-4a60-9de8-70de92c8f0d7 req-75e9dc4c-5875-4300-9a6c-4029b90b7d7b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state active and task_state rescuing.
Nov 16 18:13:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:38 user nova-compute[75342]: DEBUG nova.compute.manager [None req-f6a9bc5c-12a4-477a-adf6-d9946f1da080 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:13:41 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:13:41 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:13:42 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:13:42 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:13:42 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:13:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:13:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:13:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:46 user nova-compute[75342]: INFO nova.compute.manager [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Terminating instance
Nov 16 18:13:46 user nova-compute[75342]: DEBUG nova.compute.manager [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-a2924c05-9ee5-4288-8489-504d88210849 req-c90effbe-44dc-489a-b689-2841809f8007 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Received event network-vif-unplugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2924c05-9ee5-4288-8489-504d88210849 req-c90effbe-44dc-489a-b689-2841809f8007 service nova] Acquiring lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2924c05-9ee5-4288-8489-504d88210849 req-c90effbe-44dc-489a-b689-2841809f8007 service nova] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2924c05-9ee5-4288-8489-504d88210849 req-c90effbe-44dc-489a-b689-2841809f8007 service nova] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-a2924c05-9ee5-4288-8489-504d88210849 req-c90effbe-44dc-489a-b689-2841809f8007 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] No waiting events found dispatching network-vif-unplugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-a2924c05-9ee5-4288-8489-504d88210849 req-c90effbe-44dc-489a-b689-2841809f8007 service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Received event network-vif-unplugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Instance destroyed successfully.
Nov 16 18:13:47 user nova-compute[75342]: DEBUG nova.objects.instance [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'resources' on Instance uuid 1ce7aa5b-319e-4167-afc8-bcacd55fd794 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1687268475',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1687268475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1687268475',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw1xv74zn5ZgLcLpqsv13QtMcyML1iDaJpGrxH2X815ufey1ewK6UhKfQu+6DiHxuCDU0vPXDlDHjCf/HIcnJ5Sk+q9NMuRVlc3BqnAr/Q67DItNm7/6KWgEOWvE3CG7w==',key_name='tempest-keypair-1270973874',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:09:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-fbeua5m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:09:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062cd6d338014493be6c40701d2a735b',uuid=1ce7aa5b-319e-4167-afc8-bcacd55fd794,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "address": "fa:16:3e:0a:cd:6c", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e36c11c-a2", "ovs_interfaceid": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "address": "fa:16:3e:0a:cd:6c", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e36c11c-a2", "ovs_interfaceid": "4e36c11c-a2ec-4447-bfcc-c120ceaa8338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:cd:6c,bridge_name='br-int',has_traffic_filtering=True,id=4e36c11c-a2ec-4447-bfcc-c120ceaa8338,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e36c11c-a2') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_vif [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:cd:6c,bridge_name='br-int',has_traffic_filtering=True,id=4e36c11c-a2ec-4447-bfcc-c120ceaa8338,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e36c11c-a2') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e36c11c-a2, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18662f50-14ae-485a-8a7a-0d2ef43f9d62) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:47 user nova-compute[75342]: INFO os_vif [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:cd:6c,bridge_name='br-int',has_traffic_filtering=True,id=4e36c11c-a2ec-4447-bfcc-c120ceaa8338,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e36c11c-a2')
Nov 16 18:13:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEZBDqyz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:13:47 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[585873e9-8812-48ba-8a6f-ad3c0a86b494]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:13:47 user nova-compute[75342]: No targets found.
Nov 16 18:13:47 user nova-compute[75342]: iSNS:
Nov 16 18:13:47 user nova-compute[75342]: No targets found.
Nov 16 18:13:47 user nova-compute[75342]: STATIC:
Nov 16 18:13:47 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:13:47 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:13:47 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:13:47 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8
Nov 16 18:13:47 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:13:47 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:13:47 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:13:47 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:13:47 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:13:47 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1
Nov 16 18:13:47 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:13:47 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:13:47 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b
Nov 16 18:13:47 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:13:47 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:13:47 user nova-compute[75342]: FIRMWARE:
Nov 16 18:13:47 user nova-compute[75342]: No targets found.
Nov 16 18:13:47 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:13:47 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:13:47 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4050a7fc-b5e5-4dba-ada2-6808236fd985]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7844f83-1104-4fdf-b927-a7d8fa67b08e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:47 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:47 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:47 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:47 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:13:47 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:47 user nova-compute[75342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 (non-flash)
Nov 16 18:13:47 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:47 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:47 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:13:47 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4632830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1'): ({'sdc'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Removing single pathed devices sdc {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbf1938-44ca-47e9-92a1-e4e935a1d10b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[88705b3b-5d0d-434f-9a41-0b1979e50b46]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flushing IO for device /dev/sdc {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c44b71-5c72-44f4-8178-8cf5987f08df]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dac47e-9e78-4459-a334-6f18189158b7]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d099d70-beca-413d-a2df-0a4a2b2efd99]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3514e2-40be-4b57-b825-abf1d5d02b75]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1, portal: 172.16.0.220,3260]
Nov 16 18:13:48 user nova-compute[75342]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1, portal: 172.16.0.220,3260] successful.
Nov 16 18:13:48 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9908719-551d-4b1e-a106-828142f801f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9710f6b7-adbb-4b55-993d-c9a5fbeb2ca4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== disconnect_volume: return (441ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:13:48 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Deleting instance files /opt/stack/data/nova/instances/1ce7aa5b-319e-4167-afc8-bcacd55fd794_del
Nov 16 18:13:48 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Deletion of /opt/stack/data/nova/instances/1ce7aa5b-319e-4167-afc8-bcacd55fd794_del complete
Nov 16 18:13:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:48 user nova-compute[75342]: INFO nova.compute.manager [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Took 1.73 seconds to destroy the instance on the hypervisor.
Nov 16 18:13:48 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:13:48 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:13:48 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7786MB free_disk=25.03626251220703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Applying migration context for instance 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 as it has an incoming, in-progress migration da0b93a3-b601-4a82-bc33-7901e61b8390. Migration status is finished {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 18:13:48 user nova-compute[75342]: INFO nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updating resource usage from migration da0b93a3-b601-4a82-bc33-7901e61b8390
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 120e116f-a0e5-406c-9883-6f173da89100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 1ce7aa5b-319e-4167-afc8-bcacd55fd794 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c82d7adf-64ed-4573-9b2f-58c1daab2651 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Migration da0b93a3-b601-4a82-bc33-7901e61b8390 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:13:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:13:49 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:13:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-9ba47466-49f5-4238-91e8-d13ba1a84b7b req-f7201d92-2012-44c1-b082-db265299528b service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Received event network-vif-plugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9ba47466-49f5-4238-91e8-d13ba1a84b7b req-f7201d92-2012-44c1-b082-db265299528b service nova] Acquiring lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9ba47466-49f5-4238-91e8-d13ba1a84b7b req-f7201d92-2012-44c1-b082-db265299528b service nova] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9ba47466-49f5-4238-91e8-d13ba1a84b7b req-f7201d92-2012-44c1-b082-db265299528b service nova] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-9ba47466-49f5-4238-91e8-d13ba1a84b7b req-f7201d92-2012-44c1-b082-db265299528b service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] No waiting events found dispatching network-vif-plugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:13:49 user nova-compute[75342]: WARNING nova.compute.manager [req-9ba47466-49f5-4238-91e8-d13ba1a84b7b req-f7201d92-2012-44c1-b082-db265299528b service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Received unexpected event network-vif-plugged-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 for instance with vm_state active and task_state deleting.
Nov 16 18:13:49 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-cab7c32b-2efa-43c1-9bfa-3cf24a92cab0 req-dbbf6efc-8a48-40a5-afb7-b6737d2dce2b service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Received event network-vif-deleted-4e36c11c-a2ec-4447-bfcc-c120ceaa8338 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:49 user nova-compute[75342]: INFO nova.compute.manager [req-cab7c32b-2efa-43c1-9bfa-3cf24a92cab0 req-dbbf6efc-8a48-40a5-afb7-b6737d2dce2b service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Neutron deleted interface 4e36c11c-a2ec-4447-bfcc-c120ceaa8338; detaching it from the instance and deleting it from the info cache
Nov 16 18:13:49 user nova-compute[75342]: DEBUG nova.network.neutron [req-cab7c32b-2efa-43c1-9bfa-3cf24a92cab0 req-dbbf6efc-8a48-40a5-afb7-b6737d2dce2b service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:49 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Took 1.32 seconds to deallocate network for instance.
Nov 16 18:13:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-cab7c32b-2efa-43c1-9bfa-3cf24a92cab0 req-dbbf6efc-8a48-40a5-afb7-b6737d2dce2b service nova] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Detach interface failed, port_id=4e36c11c-a2ec-4447-bfcc-c120ceaa8338, reason: Instance 1ce7aa5b-319e-4167-afc8-bcacd55fd794 could not be found. {{(pid=75342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Skipping network cache update for instance because it is being deleted. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 85cd3e12-187f-48ba-9753-e8e93787cdf4 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:50 user nova-compute[75342]: INFO nova.compute.manager [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Unshelving
Nov 16 18:13:50 user nova-compute[75342]: INFO nova.compute.manager [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Took 0.82 seconds to detach 1 volumes for instance.
Nov 16 18:13:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 1ce7aa5b-319e-4167-afc8-bcacd55fd794] Deleting volume: b9908719-551d-4b1e-a106-828142f801f1 {{(pid=75342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 18:13:50 user nova-compute[75342]: INFO nova.virt.block_device [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Booting with volume a6258ccc-4998-46d4-b129-99252c6e5519 at /dev/vda
Nov 16 18:13:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updating instance_info_cache with network_info: [{"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-85cd3e12-187f-48ba-9753-e8e93787cdf4" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG os_brick.utils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[726c920e-964d-477d-9ffd-c4fc941a262d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c19ea2-e315-40b3-b46e-521147cff366]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce33069-7a8f-4c8f-852a-478bc1850178]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d279321-67e9-440a-b0af-e455bb3bcfb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:13:50 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:13:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[500e001b-5323-4e36-9cdd-d11c55a3dc27]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG os_brick.utils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:13:50 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating existing volume attachment record: f2141b94-96e8-4e01-8a02-b130253e4d21 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:13:51 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:13:51 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:13:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.573s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:51 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Deleted allocations for instance 1ce7aa5b-319e-4167-afc8-bcacd55fd794
Nov 16 18:13:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-68a95dbd-d5f6-442a-a2b0-7eb396146b97 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "1ce7aa5b-319e-4167-afc8-bcacd55fd794" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.788s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:56 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lazy-loading 'pci_requests' on Instance uuid d4c63c32-8406-4498-b4de-8e8ecbc2a173 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:56 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lazy-loading 'numa_topology' on Instance uuid d4c63c32-8406-4498-b4de-8e8ecbc2a173 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:13:56 user nova-compute[75342]: INFO nova.compute.claims [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Claim successful on node user
Nov 16 18:13:56 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:13:56 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:13:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:56 user nova-compute[75342]: INFO nova.network.neutron [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating port 1f0e212f-0cb1-47be-b27f-90feb2b3568f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquired lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.network.neutron [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.compute.manager [req-f344b517-7fca-4849-bbe4-7f2126351f94 req-73cf6390-433e-4938-aba9-dcb9b3de2d0f service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-changed-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.compute.manager [req-f344b517-7fca-4849-bbe4-7f2126351f94 req-73cf6390-433e-4938-aba9-dcb9b3de2d0f service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Refreshing instance network info cache due to event network-changed-1f0e212f-0cb1-47be-b27f-90feb2b3568f. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f344b517-7fca-4849-bbe4-7f2126351f94 req-73cf6390-433e-4938-aba9-dcb9b3de2d0f service nova] Acquiring lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.network.neutron [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating instance_info_cache with network_info: [{"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Releasing lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:13:57 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Creating image(s)
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Ensure instance console log exists: /opt/stack/data/nova/instances/d4c63c32-8406-4498-b4de-8e8ecbc2a173/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Start _get_guest_xml network_info=[{"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f2141b94-96e8-4e01-8a02-b130253e4d21', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlBGrdDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd4c63c32-8406-4498-b4de-8e8ecbc2a173', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6258ccc-4998-46d4-b129-99252c6e5519', 'serial': 'a6258ccc-4998-46d4-b129-99252c6e5519'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f344b517-7fca-4849-bbe4-7f2126351f94 req-73cf6390-433e-4938-aba9-dcb9b3de2d0f service nova] Acquired lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.network.neutron [req-f344b517-7fca-4849-bbe4-7f2126351f94 req-73cf6390-433e-4938-aba9-dcb9b3de2d0f service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Refreshing network info cache for port 1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:13:57 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:13:57 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4c63c32-8406-4498-b4de-8e8ecbc2a173 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.objects.base [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Object Instance<d4c63c32-8406-4498-b4de-8e8ecbc2a173> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlBGrdDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:13:57 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:13:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:13:57 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:13:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:13:57 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeee8341-6709-42aa-a1e8-a02bed1cc4ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:13:57 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[58be4b79-c28b-4ec0-8937-7dc2fb83494b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519] added
Nov 16 18:13:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2868a003-a3d4-48ef-97e1-959090880dc1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdd1268-0bb5-40b0-a938-0e6a40afa4ac]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlBGrdDP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlBGrdDP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae59fbe6-1051-4424-b080-10edbfde5e65]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XlBGrdDP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfebb74-3fd0-4beb-893e-7435a707ece9]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c00ca65-0c75-4e0b-ba61-203ebdd6e42e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:13:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:13:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0533655-b731-4301-9262-2e4fc37330c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260]
Nov 16 18:13:58 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260] successful.
Nov 16 18:13:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6369600a-0dc5-49ed-b034-6b35988a9689]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e0d591-3f45-4320-a320-690bedc9a812]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:13:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:13:58 user nova-compute[75342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:13:58 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0da443-fcbd-4e9a-98e0-b197a43b2116]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG nova.network.neutron [req-f344b517-7fca-4849-bbe4-7f2126351f94 req-73cf6390-433e-4938-aba9-dcb9b3de2d0f service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updated VIF entry in instance network info cache for port 1f0e212f-0cb1-47be-b27f-90feb2b3568f. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG nova.network.neutron [req-f344b517-7fca-4849-bbe4-7f2126351f94 req-73cf6390-433e-4938-aba9-dcb9b3de2d0f service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating instance_info_cache with network_info: [{"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f344b517-7fca-4849-bbe4-7f2126351f94 req-73cf6390-433e-4938-aba9-dcb9b3de2d0f service nova] Releasing lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:13:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlBGrdDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23738626534666266', 'path': '/dev/sdc'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738626534666266', 'path': '/dev/sdc'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1011058480',display_name='tempest-TestShelveInstance-server-1011058480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1011058480',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2005458468',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cf819660602345c6acdb1caeff5bf347',ramdisk_id='',reservation_id='r-tij2s1qg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2088508252',owner_user_name='tempest-TestShelveInstance-2088508252-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:13:51Z,user_data=None,user_id='ba8b928d71ce4f918f0d5d6bd78b0ebb',uuid=d4c63c32-8406-4498-b4de-8e8ecbc2a173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converting VIF {"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lazy-loading 'pci_devices' on Instance uuid d4c63c32-8406-4498-b4de-8e8ecbc2a173 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.objects.base [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Object Instance<d4c63c32-8406-4498-b4de-8e8ecbc2a173> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:13:59 user nova-compute[75342]:   <uuid>d4c63c32-8406-4498-b4de-8e8ecbc2a173</uuid>
Nov 16 18:13:59 user nova-compute[75342]:   <name>instance-0000001d</name>
Nov 16 18:13:59 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:13:59 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:13:59 user nova-compute[75342]:   <metadata>
Nov 16 18:13:59 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:13:59 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:13:59 user nova-compute[75342]:       <nova:name>tempest-TestShelveInstance-server-1011058480</nova:name>
Nov 16 18:13:59 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:13:57</nova:creationTime>
Nov 16 18:13:59 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:13:59 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:13:59 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:13:59 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:13:59 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:13:59 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:13:59 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:13:59 user nova-compute[75342]:       <nova:owner>
Nov 16 18:13:59 user nova-compute[75342]:         <nova:user uuid="ba8b928d71ce4f918f0d5d6bd78b0ebb">tempest-TestShelveInstance-2088508252-project-member</nova:user>
Nov 16 18:13:59 user nova-compute[75342]:         <nova:project uuid="cf819660602345c6acdb1caeff5bf347">tempest-TestShelveInstance-2088508252</nova:project>
Nov 16 18:13:59 user nova-compute[75342]:       </nova:owner>
Nov 16 18:13:59 user nova-compute[75342]:       <nova:ports>
Nov 16 18:13:59 user nova-compute[75342]:         <nova:port uuid="1f0e212f-0cb1-47be-b27f-90feb2b3568f">
Nov 16 18:13:59 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 18:13:59 user nova-compute[75342]:         </nova:port>
Nov 16 18:13:59 user nova-compute[75342]:       </nova:ports>
Nov 16 18:13:59 user nova-compute[75342]:     </nova:instance>
Nov 16 18:13:59 user nova-compute[75342]:   </metadata>
Nov 16 18:13:59 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:13:59 user nova-compute[75342]:     <system>
Nov 16 18:13:59 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:13:59 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:13:59 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:13:59 user nova-compute[75342]:       <entry name="serial">d4c63c32-8406-4498-b4de-8e8ecbc2a173</entry>
Nov 16 18:13:59 user nova-compute[75342]:       <entry name="uuid">d4c63c32-8406-4498-b4de-8e8ecbc2a173</entry>
Nov 16 18:13:59 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:13:59 user nova-compute[75342]:     </system>
Nov 16 18:13:59 user nova-compute[75342]:   </sysinfo>
Nov 16 18:13:59 user nova-compute[75342]:   <os>
Nov 16 18:13:59 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:13:59 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:13:59 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:13:59 user nova-compute[75342]:   </os>
Nov 16 18:13:59 user nova-compute[75342]:   <features>
Nov 16 18:13:59 user nova-compute[75342]:     <acpi/>
Nov 16 18:13:59 user nova-compute[75342]:     <apic/>
Nov 16 18:13:59 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:13:59 user nova-compute[75342]:   </features>
Nov 16 18:13:59 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:13:59 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:13:59 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:13:59 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:13:59 user nova-compute[75342]:   </clock>
Nov 16 18:13:59 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:13:59 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:13:59 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:13:59 user nova-compute[75342]:   </cpu>
Nov 16 18:13:59 user nova-compute[75342]:   <devices>
Nov 16 18:13:59 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:13:59 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:13:59 user nova-compute[75342]:       <source dev="/dev/sdc"/>
Nov 16 18:13:59 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:13:59 user nova-compute[75342]:       <serial>a6258ccc-4998-46d4-b129-99252c6e5519</serial>
Nov 16 18:13:59 user nova-compute[75342]:     </disk>
Nov 16 18:13:59 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:13:59 user nova-compute[75342]:       <mac address="fa:16:3e:88:5e:82"/>
Nov 16 18:13:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:13:59 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:13:59 user nova-compute[75342]:       <target dev="tap1f0e212f-0c"/>
Nov 16 18:13:59 user nova-compute[75342]:     </interface>
Nov 16 18:13:59 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:13:59 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/d4c63c32-8406-4498-b4de-8e8ecbc2a173/console.log" append="off"/>
Nov 16 18:13:59 user nova-compute[75342]:     </serial>
Nov 16 18:13:59 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:13:59 user nova-compute[75342]:     <video>
Nov 16 18:13:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:13:59 user nova-compute[75342]:     </video>
Nov 16 18:13:59 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:13:59 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:13:59 user nova-compute[75342]:     </rng>
Nov 16 18:13:59 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:13:59 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:13:59 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:13:59 user nova-compute[75342]:     </memballoon>
Nov 16 18:13:59 user nova-compute[75342]:   </devices>
Nov 16 18:13:59 user nova-compute[75342]: </domain>
Nov 16 18:13:59 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1011058480',display_name='tempest-TestShelveInstance-server-1011058480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1011058480',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2005458468',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cf819660602345c6acdb1caeff5bf347',ramdisk_id='',reservation_id='r-tij2s1qg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2088508252',owner_user_name='tempest-TestShelveInstance-2088508252-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:13:51Z,user_data=None,user_id='ba8b928d71ce4f918f0d5d6bd78b0ebb',uuid=d4c63c32-8406-4498-b4de-8e8ecbc2a173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converting VIF {"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG os_vif [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa8a868d-8518-5af5-abf0-fa9d5d9c7d97', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f0e212f-0c, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f0e212f-0c, col_values=(('qos', UUID('c666d57b-7332-4f87-a450-b59345a5428d')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f0e212f-0c, col_values=(('external_ids', {'iface-id': '1f0e212f-0cb1-47be-b27f-90feb2b3568f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:5e:82', 'vm-uuid': 'd4c63c32-8406-4498-b4de-8e8ecbc2a173'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:13:59 user nova-compute[75342]: INFO os_vif [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c')
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:13:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] No VIF found with MAC fa:16:3e:88:5e:82, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:14:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-1658791a-e52c-452b-a20b-a33af769bd61 req-8956d56e-cd29-4ca0-9bd4-75723cf3491c service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:14:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1658791a-e52c-452b-a20b-a33af769bd61 req-8956d56e-cd29-4ca0-9bd4-75723cf3491c service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1658791a-e52c-452b-a20b-a33af769bd61 req-8956d56e-cd29-4ca0-9bd4-75723cf3491c service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1658791a-e52c-452b-a20b-a33af769bd61 req-8956d56e-cd29-4ca0-9bd4-75723cf3491c service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-1658791a-e52c-452b-a20b-a33af769bd61 req-8956d56e-cd29-4ca0-9bd4-75723cf3491c service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:14:00 user nova-compute[75342]: WARNING nova.compute.manager [req-1658791a-e52c-452b-a20b-a33af769bd61 req-8956d56e-cd29-4ca0-9bd4-75723cf3491c service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 18:14:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:14:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:14:02 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Instance spawned successfully.
Nov 16 18:14:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:14:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8e5d1857-3cba-4d2d-8aac-2dc93b692471 tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.238s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-0949d0cc-14af-46d7-828c-daa0870a7ba9 req-5b8bcdfb-71b7-47bc-a784-fd2e2ea74e6e service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:14:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0949d0cc-14af-46d7-828c-daa0870a7ba9 req-5b8bcdfb-71b7-47bc-a784-fd2e2ea74e6e service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0949d0cc-14af-46d7-828c-daa0870a7ba9 req-5b8bcdfb-71b7-47bc-a784-fd2e2ea74e6e service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0949d0cc-14af-46d7-828c-daa0870a7ba9 req-5b8bcdfb-71b7-47bc-a784-fd2e2ea74e6e service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-0949d0cc-14af-46d7-828c-daa0870a7ba9 req-5b8bcdfb-71b7-47bc-a784-fd2e2ea74e6e service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:14:02 user nova-compute[75342]: WARNING nova.compute.manager [req-0949d0cc-14af-46d7-828c-daa0870a7ba9 req-5b8bcdfb-71b7-47bc-a784-fd2e2ea74e6e service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state active and task_state None.
Nov 16 18:14:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:14:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:14:15 user nova-compute[75342]: INFO nova.compute.claims [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Claim successful on node user
Nov 16 18:14:15 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:14:15 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:14:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:14:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:14:15 user nova-compute[75342]: DEBUG nova.network.neutron [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:14:15 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:14:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG nova.policy [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '864edacddf7b48e4aaf60fd93cafb684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2189db5a95468dbf66c195eb817345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:14:16 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Creating image(s)
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "/opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "/opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "/opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk 1073741824" returned: 0 in 0.046s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG nova.network.neutron [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Successfully created port: b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Cannot resize image /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Ensure instance console log exists: /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Successfully updated port: b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "refresh_cache-c53c3ddf-a478-4692-81b0-1b3e403f0cea" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquired lock "refresh_cache-c53c3ddf-a478-4692-81b0-1b3e403f0cea" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-9129d9e4-a66b-42fc-b0a9-7ff668cb0532 req-fd417a3b-031e-4c6a-9993-2ec9f4da15fe service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Received event network-changed-b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-9129d9e4-a66b-42fc-b0a9-7ff668cb0532 req-fd417a3b-031e-4c6a-9993-2ec9f4da15fe service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Refreshing instance network info cache due to event network-changed-b1c08917-dbca-468f-92ac-12cdf2c61fc5. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9129d9e4-a66b-42fc-b0a9-7ff668cb0532 req-fd417a3b-031e-4c6a-9993-2ec9f4da15fe service nova] Acquiring lock "refresh_cache-c53c3ddf-a478-4692-81b0-1b3e403f0cea" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Updating instance_info_cache with network_info: [{"id": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "address": "fa:16:3e:b6:12:d4", "network": {"id": "ca4da789-6833-4b42-bbb2-d90a38f7e1b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110095711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2189db5a95468dbf66c195eb817345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c08917-db", "ovs_interfaceid": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Releasing lock "refresh_cache-c53c3ddf-a478-4692-81b0-1b3e403f0cea" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Instance network_info: |[{"id": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "address": "fa:16:3e:b6:12:d4", "network": {"id": "ca4da789-6833-4b42-bbb2-d90a38f7e1b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110095711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2189db5a95468dbf66c195eb817345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c08917-db", "ovs_interfaceid": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9129d9e4-a66b-42fc-b0a9-7ff668cb0532 req-fd417a3b-031e-4c6a-9993-2ec9f4da15fe service nova] Acquired lock "refresh_cache-c53c3ddf-a478-4692-81b0-1b3e403f0cea" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.network.neutron [req-9129d9e4-a66b-42fc-b0a9-7ff668cb0532 req-fd417a3b-031e-4c6a-9993-2ec9f4da15fe service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Refreshing network info cache for port b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Start _get_guest_xml network_info=[{"id": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "address": "fa:16:3e:b6:12:d4", "network": {"id": "ca4da789-6833-4b42-bbb2-d90a38f7e1b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110095711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2189db5a95468dbf66c195eb817345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c08917-db", "ovs_interfaceid": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:14:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:14:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2136336470',display_name='tempest-TestServerVolumeAttachmentScenario-server-2136336470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2136336470',id=35,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEgWgtXVjvlvc+0jBP2XzrV+ixRMPpLNdTrr5gkPCXVsQkvJIBhDinYMQ8Z60PWxUjg5tybTTHX4nU4spfr2tzB70ZPVUsMc/OXv9DgIZe3pwVsmZaYHcNynJtrjlTA9Q==',key_name='tempest-keypair-1778937027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb2189db5a95468dbf66c195eb817345',ramdisk_id='',reservation_id='r-agn8cp8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1576288846',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1576288846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='864edacddf7b48e4aaf60fd93cafb684',uuid=c53c3ddf-a478-4692-81b0-1b3e403f0cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "address": "fa:16:3e:b6:12:d4", "network": {"id": "ca4da789-6833-4b42-bbb2-d90a38f7e1b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110095711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2189db5a95468dbf66c195eb817345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c08917-db", "ovs_interfaceid": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Converting VIF {"id": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "address": "fa:16:3e:b6:12:d4", "network": {"id": "ca4da789-6833-4b42-bbb2-d90a38f7e1b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110095711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2189db5a95468dbf66c195eb817345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c08917-db", "ovs_interfaceid": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:12:d4,bridge_name='br-int',has_traffic_filtering=True,id=b1c08917-dbca-468f-92ac-12cdf2c61fc5,network=Network(ca4da789-6833-4b42-bbb2-d90a38f7e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c08917-db') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.objects.instance [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lazy-loading 'pci_devices' on Instance uuid c53c3ddf-a478-4692-81b0-1b3e403f0cea {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:14:17 user nova-compute[75342]:   <uuid>c53c3ddf-a478-4692-81b0-1b3e403f0cea</uuid>
Nov 16 18:14:17 user nova-compute[75342]:   <name>instance-00000023</name>
Nov 16 18:14:17 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:14:17 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:14:17 user nova-compute[75342]:   <metadata>
Nov 16 18:14:17 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:14:17 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:14:17 user nova-compute[75342]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2136336470</nova:name>
Nov 16 18:14:17 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:14:17</nova:creationTime>
Nov 16 18:14:17 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:14:17 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:14:17 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:14:17 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:14:17 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:14:17 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:14:17 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:14:17 user nova-compute[75342]:       <nova:owner>
Nov 16 18:14:17 user nova-compute[75342]:         <nova:user uuid="864edacddf7b48e4aaf60fd93cafb684">tempest-TestServerVolumeAttachmentScenario-1576288846-project-member</nova:user>
Nov 16 18:14:17 user nova-compute[75342]:         <nova:project uuid="cb2189db5a95468dbf66c195eb817345">tempest-TestServerVolumeAttachmentScenario-1576288846</nova:project>
Nov 16 18:14:17 user nova-compute[75342]:       </nova:owner>
Nov 16 18:14:17 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:14:17 user nova-compute[75342]:       <nova:ports>
Nov 16 18:14:17 user nova-compute[75342]:         <nova:port uuid="b1c08917-dbca-468f-92ac-12cdf2c61fc5">
Nov 16 18:14:17 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 18:14:17 user nova-compute[75342]:         </nova:port>
Nov 16 18:14:17 user nova-compute[75342]:       </nova:ports>
Nov 16 18:14:17 user nova-compute[75342]:     </nova:instance>
Nov 16 18:14:17 user nova-compute[75342]:   </metadata>
Nov 16 18:14:17 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:14:17 user nova-compute[75342]:     <system>
Nov 16 18:14:17 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:14:17 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:14:17 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:14:17 user nova-compute[75342]:       <entry name="serial">c53c3ddf-a478-4692-81b0-1b3e403f0cea</entry>
Nov 16 18:14:17 user nova-compute[75342]:       <entry name="uuid">c53c3ddf-a478-4692-81b0-1b3e403f0cea</entry>
Nov 16 18:14:17 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:14:17 user nova-compute[75342]:     </system>
Nov 16 18:14:17 user nova-compute[75342]:   </sysinfo>
Nov 16 18:14:17 user nova-compute[75342]:   <os>
Nov 16 18:14:17 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:14:17 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:14:17 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:14:17 user nova-compute[75342]:   </os>
Nov 16 18:14:17 user nova-compute[75342]:   <features>
Nov 16 18:14:17 user nova-compute[75342]:     <acpi/>
Nov 16 18:14:17 user nova-compute[75342]:     <apic/>
Nov 16 18:14:17 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:14:17 user nova-compute[75342]:   </features>
Nov 16 18:14:17 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:14:17 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:14:17 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:14:17 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:14:17 user nova-compute[75342]:   </clock>
Nov 16 18:14:17 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:14:17 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:14:17 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:14:17 user nova-compute[75342]:   </cpu>
Nov 16 18:14:17 user nova-compute[75342]:   <devices>
Nov 16 18:14:17 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:14:17 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:14:17 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk"/>
Nov 16 18:14:17 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:14:17 user nova-compute[75342]:     </disk>
Nov 16 18:14:17 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:14:17 user nova-compute[75342]:       <mac address="fa:16:3e:b6:12:d4"/>
Nov 16 18:14:17 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:14:17 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:14:17 user nova-compute[75342]:       <target dev="tapb1c08917-db"/>
Nov 16 18:14:17 user nova-compute[75342]:     </interface>
Nov 16 18:14:17 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:14:17 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/console.log" append="off"/>
Nov 16 18:14:17 user nova-compute[75342]:     </serial>
Nov 16 18:14:17 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:14:17 user nova-compute[75342]:     <video>
Nov 16 18:14:17 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:14:17 user nova-compute[75342]:     </video>
Nov 16 18:14:17 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:14:17 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:14:17 user nova-compute[75342]:     </rng>
Nov 16 18:14:17 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:14:17 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:14:17 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:14:17 user nova-compute[75342]:     </memballoon>
Nov 16 18:14:17 user nova-compute[75342]:   </devices>
Nov 16 18:14:17 user nova-compute[75342]: </domain>
Nov 16 18:14:17 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2136336470',display_name='tempest-TestServerVolumeAttachmentScenario-server-2136336470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2136336470',id=35,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEgWgtXVjvlvc+0jBP2XzrV+ixRMPpLNdTrr5gkPCXVsQkvJIBhDinYMQ8Z60PWxUjg5tybTTHX4nU4spfr2tzB70ZPVUsMc/OXv9DgIZe3pwVsmZaYHcNynJtrjlTA9Q==',key_name='tempest-keypair-1778937027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb2189db5a95468dbf66c195eb817345',ramdisk_id='',reservation_id='r-agn8cp8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1576288846',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1576288846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='864edacddf7b48e4aaf60fd93cafb684',uuid=c53c3ddf-a478-4692-81b0-1b3e403f0cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "address": "fa:16:3e:b6:12:d4", "network": {"id": "ca4da789-6833-4b42-bbb2-d90a38f7e1b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110095711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2189db5a95468dbf66c195eb817345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c08917-db", "ovs_interfaceid": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Converting VIF {"id": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "address": "fa:16:3e:b6:12:d4", "network": {"id": "ca4da789-6833-4b42-bbb2-d90a38f7e1b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110095711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2189db5a95468dbf66c195eb817345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c08917-db", "ovs_interfaceid": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:12:d4,bridge_name='br-int',has_traffic_filtering=True,id=b1c08917-dbca-468f-92ac-12cdf2c61fc5,network=Network(ca4da789-6833-4b42-bbb2-d90a38f7e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c08917-db') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG os_vif [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:12:d4,bridge_name='br-int',has_traffic_filtering=True,id=b1c08917-dbca-468f-92ac-12cdf2c61fc5,network=Network(ca4da789-6833-4b42-bbb2-d90a38f7e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c08917-db') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33123091-29e9-5cf0-8e6a-398943d2b03d', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1c08917-db, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1c08917-db, col_values=(('qos', UUID('bc9c9683-0660-4774-b5bc-b997362f4b06')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1c08917-db, col_values=(('external_ids', {'iface-id': 'b1c08917-dbca-468f-92ac-12cdf2c61fc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:12:d4', 'vm-uuid': 'c53c3ddf-a478-4692-81b0-1b3e403f0cea'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:17 user nova-compute[75342]: INFO os_vif [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:12:d4,bridge_name='br-int',has_traffic_filtering=True,id=b1c08917-dbca-468f-92ac-12cdf2c61fc5,network=Network(ca4da789-6833-4b42-bbb2-d90a38f7e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c08917-db')
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:14:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] No VIF found with MAC fa:16:3e:b6:12:d4, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:14:18 user nova-compute[75342]: DEBUG nova.network.neutron [req-9129d9e4-a66b-42fc-b0a9-7ff668cb0532 req-fd417a3b-031e-4c6a-9993-2ec9f4da15fe service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Updated VIF entry in instance network info cache for port b1c08917-dbca-468f-92ac-12cdf2c61fc5. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:14:18 user nova-compute[75342]: DEBUG nova.network.neutron [req-9129d9e4-a66b-42fc-b0a9-7ff668cb0532 req-fd417a3b-031e-4c6a-9993-2ec9f4da15fe service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Updating instance_info_cache with network_info: [{"id": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "address": "fa:16:3e:b6:12:d4", "network": {"id": "ca4da789-6833-4b42-bbb2-d90a38f7e1b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110095711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2189db5a95468dbf66c195eb817345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c08917-db", "ovs_interfaceid": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:14:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9129d9e4-a66b-42fc-b0a9-7ff668cb0532 req-fd417a3b-031e-4c6a-9993-2ec9f4da15fe service nova] Releasing lock "refresh_cache-c53c3ddf-a478-4692-81b0-1b3e403f0cea" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:14:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-817ea6de-05bc-44b5-a1d1-d3eb84517c2c req-1713d997-2719-4e0d-8ce7-73930472ed3f service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Received event network-vif-plugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-817ea6de-05bc-44b5-a1d1-d3eb84517c2c req-1713d997-2719-4e0d-8ce7-73930472ed3f service nova] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-817ea6de-05bc-44b5-a1d1-d3eb84517c2c req-1713d997-2719-4e0d-8ce7-73930472ed3f service nova] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-817ea6de-05bc-44b5-a1d1-d3eb84517c2c req-1713d997-2719-4e0d-8ce7-73930472ed3f service nova] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-817ea6de-05bc-44b5-a1d1-d3eb84517c2c req-1713d997-2719-4e0d-8ce7-73930472ed3f service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] No waiting events found dispatching network-vif-plugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:14:19 user nova-compute[75342]: WARNING nova.compute.manager [req-817ea6de-05bc-44b5-a1d1-d3eb84517c2c req-1713d997-2719-4e0d-8ce7-73930472ed3f service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Received unexpected event network-vif-plugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 for instance with vm_state building and task_state spawning.
Nov 16 18:14:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:14:21 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Instance spawned successfully.
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:21 user nova-compute[75342]: INFO nova.compute.manager [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-ac1e4099-7694-4e81-9764-872616fa394a req-136d6ed6-5a51-422c-93fc-9b003319ae1a service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Received event network-vif-plugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ac1e4099-7694-4e81-9764-872616fa394a req-136d6ed6-5a51-422c-93fc-9b003319ae1a service nova] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ac1e4099-7694-4e81-9764-872616fa394a req-136d6ed6-5a51-422c-93fc-9b003319ae1a service nova] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ac1e4099-7694-4e81-9764-872616fa394a req-136d6ed6-5a51-422c-93fc-9b003319ae1a service nova] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-ac1e4099-7694-4e81-9764-872616fa394a req-136d6ed6-5a51-422c-93fc-9b003319ae1a service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] No waiting events found dispatching network-vif-plugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:14:21 user nova-compute[75342]: WARNING nova.compute.manager [req-ac1e4099-7694-4e81-9764-872616fa394a req-136d6ed6-5a51-422c-93fc-9b003319ae1a service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Received unexpected event network-vif-plugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 for instance with vm_state building and task_state spawning.
Nov 16 18:14:21 user nova-compute[75342]: INFO nova.compute.manager [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Took 6.11 seconds to build instance.
Nov 16 18:14:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-37e17cd4-ea86-4a76-9577-353643b6a4e0 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.209s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:42 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:14:42 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:14:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:14:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:14:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:14:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:44 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "d45e0bb0-526c-4940-a196-b21ff0589987" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d45e0bb0-526c-4940-a196-b21ff0589987" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:14:45 user nova-compute[75342]: INFO nova.compute.claims [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Claim successful on node user
Nov 16 18:14:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquired lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'info_cache' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.objects.base [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.514s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:14:45 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:14:45 user nova-compute[75342]: DEBUG nova.policy [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '062cd6d338014493be6c40701d2a735b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d44dce2b444ef386b47927d5c70c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:14:45 user nova-compute[75342]: INFO nova.virt.block_device [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Booting with volume f1b7789f-96b0-4cc3-9042-ad3199d965da at /dev/vda
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG os_brick.utils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Updating instance_info_cache with network_info: [{"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f954f57-d5c3-4002-a254-f3a0e83271a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Releasing lock "refresh_cache-361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4836514a-695e-45f5-8cf3-06a24a083a87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf2db8-fe00-4de5-aaaa-ecb6a2e9ee99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:46 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance destroyed successfully.
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf28b0e-063a-4097-a0ec-f82c89cffbeb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'resources' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.objects.base [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2074580807',display_name='tempest-AttachVolumeTestJSON-server-2074580807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2074580807',id=25,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPFfdYGYtdfUwjEiOE/iwsDZ8HxFnxrUjMrOXe3mcWU8NAzXmZ0SHoyGfYP5VBo3S4o53/E3MwQVBkBzuKmzbRAXUrMsihBETp/TApLvk6647LfkR70K66wWqQJP/b4A==',key_name='tempest-keypair-1267583389',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-pms15lgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=361ee32d-4ad3-4bd3-bdf9-6fd404d0f297,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG os_vif [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap326f6a9c-15, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d85fe2b-238b-4099-8cfd-a6dbf1a58bad) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:14:46 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[038c28e5-ba9f-4d52-9b9c-47ed7925b8a9]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG os_brick.utils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Updating existing volume attachment record: 18e07a6f-3bbb-4454-82e9-2d1700bc47a7 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: INFO os_vif [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15')
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Start _get_guest_xml network_info=[{"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'numa_topology' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.objects.base [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:14:46 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:14:46 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'vcpu_model' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.objects.base [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2074580807',display_name='tempest-AttachVolumeTestJSON-server-2074580807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2074580807',id=25,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPFfdYGYtdfUwjEiOE/iwsDZ8HxFnxrUjMrOXe3mcWU8NAzXmZ0SHoyGfYP5VBo3S4o53/E3MwQVBkBzuKmzbRAXUrMsihBETp/TApLvk6647LfkR70K66wWqQJP/b4A==',key_name='tempest-keypair-1267583389',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-pms15lgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=361ee32d-4ad3-4bd3-bdf9-6fd404d0f297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'pci_devices' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.objects.base [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:14:46 user nova-compute[75342]:   <uuid>361ee32d-4ad3-4bd3-bdf9-6fd404d0f297</uuid>
Nov 16 18:14:46 user nova-compute[75342]:   <name>instance-00000019</name>
Nov 16 18:14:46 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:14:46 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:14:46 user nova-compute[75342]:   <metadata>
Nov 16 18:14:46 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:14:46 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:14:46 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeTestJSON-server-2074580807</nova:name>
Nov 16 18:14:46 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:14:46</nova:creationTime>
Nov 16 18:14:46 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:14:46 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:14:46 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:14:46 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:14:46 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:14:46 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:14:46 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:14:46 user nova-compute[75342]:       <nova:owner>
Nov 16 18:14:46 user nova-compute[75342]:         <nova:user uuid="1da0d585d0e04be284e3eb50ce093d89">tempest-AttachVolumeTestJSON-410390487-project-member</nova:user>
Nov 16 18:14:46 user nova-compute[75342]:         <nova:project uuid="6b7dafce5e534279b01a17644c620e36">tempest-AttachVolumeTestJSON-410390487</nova:project>
Nov 16 18:14:46 user nova-compute[75342]:       </nova:owner>
Nov 16 18:14:46 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:14:46 user nova-compute[75342]:       <nova:ports>
Nov 16 18:14:46 user nova-compute[75342]:         <nova:port uuid="326f6a9c-1559-4846-b2df-cb6b8ac9eed9">
Nov 16 18:14:46 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 18:14:46 user nova-compute[75342]:         </nova:port>
Nov 16 18:14:46 user nova-compute[75342]:       </nova:ports>
Nov 16 18:14:46 user nova-compute[75342]:     </nova:instance>
Nov 16 18:14:46 user nova-compute[75342]:   </metadata>
Nov 16 18:14:46 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:14:46 user nova-compute[75342]:     <system>
Nov 16 18:14:46 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:14:46 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:14:46 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:14:46 user nova-compute[75342]:       <entry name="serial">361ee32d-4ad3-4bd3-bdf9-6fd404d0f297</entry>
Nov 16 18:14:46 user nova-compute[75342]:       <entry name="uuid">361ee32d-4ad3-4bd3-bdf9-6fd404d0f297</entry>
Nov 16 18:14:46 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:14:46 user nova-compute[75342]:     </system>
Nov 16 18:14:46 user nova-compute[75342]:   </sysinfo>
Nov 16 18:14:46 user nova-compute[75342]:   <os>
Nov 16 18:14:46 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:14:46 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:14:46 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:14:46 user nova-compute[75342]:   </os>
Nov 16 18:14:46 user nova-compute[75342]:   <features>
Nov 16 18:14:46 user nova-compute[75342]:     <acpi/>
Nov 16 18:14:46 user nova-compute[75342]:     <apic/>
Nov 16 18:14:46 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:14:46 user nova-compute[75342]:   </features>
Nov 16 18:14:46 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:14:46 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:14:46 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:14:46 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:14:46 user nova-compute[75342]:   </clock>
Nov 16 18:14:46 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:14:46 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:14:46 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:14:46 user nova-compute[75342]:   </cpu>
Nov 16 18:14:46 user nova-compute[75342]:   <devices>
Nov 16 18:14:46 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:14:46 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:14:46 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk"/>
Nov 16 18:14:46 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:14:46 user nova-compute[75342]:     </disk>
Nov 16 18:14:46 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:14:46 user nova-compute[75342]:       <mac address="fa:16:3e:3f:c1:5a"/>
Nov 16 18:14:46 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:14:46 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:14:46 user nova-compute[75342]:       <target dev="tap326f6a9c-15"/>
Nov 16 18:14:46 user nova-compute[75342]:     </interface>
Nov 16 18:14:46 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:14:46 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/console.log" append="off"/>
Nov 16 18:14:46 user nova-compute[75342]:     </serial>
Nov 16 18:14:46 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:14:46 user nova-compute[75342]:     <video>
Nov 16 18:14:46 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:14:46 user nova-compute[75342]:     </video>
Nov 16 18:14:46 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:14:46 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:14:46 user nova-compute[75342]:     </rng>
Nov 16 18:14:46 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:14:46 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:14:46 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:14:46 user nova-compute[75342]:     </memballoon>
Nov 16 18:14:46 user nova-compute[75342]:   </devices>
Nov 16 18:14:46 user nova-compute[75342]: </domain>
Nov 16 18:14:46 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Successfully created port: f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'trusted_certs' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.objects.base [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:14:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Cannot resize image /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'migration_context' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.objects.base [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Object Instance<361ee32d-4ad3-4bd3-bdf9-6fd404d0f297> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2074580807',display_name='tempest-AttachVolumeTestJSON-server-2074580807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2074580807',id=25,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPFfdYGYtdfUwjEiOE/iwsDZ8HxFnxrUjMrOXe3mcWU8NAzXmZ0SHoyGfYP5VBo3S4o53/E3MwQVBkBzuKmzbRAXUrMsihBETp/TApLvk6647LfkR70K66wWqQJP/b4A==',key_name='tempest-keypair-1267583389',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-pms15lgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=361ee32d-4ad3-4bd3-bdf9-6fd404d0f297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG os_vif [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43d5eb76-b0c2-5a18-acfb-a6d02ddba571', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap326f6a9c-15, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap326f6a9c-15, col_values=(('qos', UUID('4e1682a7-7ef3-4ea6-be20-f083066646b8')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap326f6a9c-15, col_values=(('external_ids', {'iface-id': '326f6a9c-1559-4846-b2df-cb6b8ac9eed9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:c1:5a', 'vm-uuid': '361ee32d-4ad3-4bd3-bdf9-6fd404d0f297'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:47 user nova-compute[75342]: INFO os_vif [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15')
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Successfully updated port: f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-79a78302-66f8-434f-9470-439b6e5036e9 req-71a31de1-cda4-431a-abe5-89bc3c6a5c61 service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Received event network-changed-f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-79a78302-66f8-434f-9470-439b6e5036e9 req-71a31de1-cda4-431a-abe5-89bc3c6a5c61 service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Refreshing instance network info cache due to event network-changed-f581155c-2be9-4fa2-8e60-2fd067dfb38d. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-79a78302-66f8-434f-9470-439b6e5036e9 req-71a31de1-cda4-431a-abe5-89bc3c6a5c61 service nova] Acquiring lock "refresh_cache-d45e0bb0-526c-4940-a196-b21ff0589987" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-79a78302-66f8-434f-9470-439b6e5036e9 req-71a31de1-cda4-431a-abe5-89bc3c6a5c61 service nova] Acquired lock "refresh_cache-d45e0bb0-526c-4940-a196-b21ff0589987" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.network.neutron [req-79a78302-66f8-434f-9470-439b6e5036e9 req-71a31de1-cda4-431a-abe5-89bc3c6a5c61 service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Refreshing network info cache for port f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "refresh_cache-d45e0bb0-526c-4940-a196-b21ff0589987" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.network.neutron [req-79a78302-66f8-434f-9470-439b6e5036e9 req-71a31de1-cda4-431a-abe5-89bc3c6a5c61 service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.network.neutron [req-79a78302-66f8-434f-9470-439b6e5036e9 req-71a31de1-cda4-431a-abe5-89bc3c6a5c61 service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-79a78302-66f8-434f-9470-439b6e5036e9 req-71a31de1-cda4-431a-abe5-89bc3c6a5c61 service nova] Releasing lock "refresh_cache-d45e0bb0-526c-4940-a196-b21ff0589987" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquired lock "refresh_cache-d45e0bb0-526c-4940-a196-b21ff0589987" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:14:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG nova.network.neutron [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Updating instance_info_cache with network_info: [{"id": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "address": "fa:16:3e:41:de:20", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf581155c-2b", "ovs_interfaceid": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Releasing lock "refresh_cache-d45e0bb0-526c-4940-a196-b21ff0589987" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Instance network_info: |[{"id": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "address": "fa:16:3e:41:de:20", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf581155c-2b", "ovs_interfaceid": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-b9dc3954-dc53-4cf0-a590-fd0ae26bf076 req-d4db70a5-a142-4933-beb7-eb363a8256a0 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b9dc3954-dc53-4cf0-a590-fd0ae26bf076 req-d4db70a5-a142-4933-beb7-eb363a8256a0 service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b9dc3954-dc53-4cf0-a590-fd0ae26bf076 req-d4db70a5-a142-4933-beb7-eb363a8256a0 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b9dc3954-dc53-4cf0-a590-fd0ae26bf076 req-d4db70a5-a142-4933-beb7-eb363a8256a0 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-b9dc3954-dc53-4cf0-a590-fd0ae26bf076 req-d4db70a5-a142-4933-beb7-eb363a8256a0 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:14:48 user nova-compute[75342]: WARNING nova.compute.manager [req-b9dc3954-dc53-4cf0-a590-fd0ae26bf076 req-d4db70a5-a142-4933-beb7-eb363a8256a0 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received unexpected event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with vm_state stopped and task_state powering-on.
Nov 16 18:14:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:14:50 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance rebooted successfully.
Nov 16 18:14:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9203951d-89d4-4290-8325-bdd6cc5abe4e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-d1e93dbe-91a4-4898-b2c8-1fd82a56b88e req-01ee1cf8-736f-4767-8ac1-6748e601ac75 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d1e93dbe-91a4-4898-b2c8-1fd82a56b88e req-01ee1cf8-736f-4767-8ac1-6748e601ac75 service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d1e93dbe-91a4-4898-b2c8-1fd82a56b88e req-01ee1cf8-736f-4767-8ac1-6748e601ac75 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d1e93dbe-91a4-4898-b2c8-1fd82a56b88e req-01ee1cf8-736f-4767-8ac1-6748e601ac75 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-d1e93dbe-91a4-4898-b2c8-1fd82a56b88e req-01ee1cf8-736f-4767-8ac1-6748e601ac75 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:14:50 user nova-compute[75342]: WARNING nova.compute.manager [req-d1e93dbe-91a4-4898-b2c8-1fd82a56b88e req-01ee1cf8-736f-4767-8ac1-6748e601ac75 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received unexpected event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with vm_state stopped and task_state powering-on.
Nov 16 18:14:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:14:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:14:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7492MB free_disk=24.99454116821289GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Going to confirm migration 2 {{(pid=75342) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Applying migration context for instance 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 as it has an incoming, in-progress migration da0b93a3-b601-4a82-bc33-7901e61b8390. Migration status is confirming {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 18:14:51 user nova-compute[75342]: INFO nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updating resource usage from migration da0b93a3-b601-4a82-bc33-7901e61b8390
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:14:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Creating image(s)
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Ensure instance console log exists: /opt/stack/data/nova/instances/d45e0bb0-526c-4940-a196-b21ff0589987/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Start _get_guest_xml network_info=[{"id": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "address": "fa:16:3e:41:de:20", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf581155c-2b", "ovs_interfaceid": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '18e07a6f-3bbb-4454-82e9-2d1700bc47a7', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAElFIVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd45e0bb0-526c-4940-a196-b21ff0589987', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1b7789f-96b0-4cc3-9042-ad3199d965da', 'serial': 'f1b7789f-96b0-4cc3-9042-ad3199d965da'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 120e116f-a0e5-406c-9883-6f173da89100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c82d7adf-64ed-4573-9b2f-58c1daab2651 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Migration da0b93a3-b601-4a82-bc33-7901e61b8390 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d4c63c32-8406-4498-b4de-8e8ecbc2a173 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c53c3ddf-a478-4692-81b0-1b3e403f0cea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d45e0bb0-526c-4940-a196-b21ff0589987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:14:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:14:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAElFIVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:14:51 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:14:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:14:51 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:14:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:14:51 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef15a0-717d-4d26-951c-00a2836c14ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:14:51 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:14:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e08878-165f-4b53-9e72-f62a22f1749b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da] added
Nov 16 18:14:52 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc78bbf2-6887-47d4-959a-d12c15576c27]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a1fae9-7998-4fc4-bf32-faede3e546e6]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAElFIVC {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAElFIVC" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[820b85b4-3c73-4455-8495-bddae750f4bb]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SAElFIVC'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9549ce14-3ce5-4300-a305-963c91a6c1b4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquired lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG nova.objects.instance [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'info_cache' on Instance uuid 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae6a5e9-a701-45b7-ae6c-54f05262aa7e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3fe7fa-fa2c-4d67-bc1d-4390b0af6bd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260]
Nov 16 18:14:52 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260] successful.
Nov 16 18:14:52 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[55495548-184d-466b-b57f-82f02ce54116]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[378c06e3-8536-4d8f-9d4c-b6119008915e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:14:52 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:14:52 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:14:52 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[77be6696-71d3-41c3-8c68-ccebec865d60]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAElFIVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.758s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updating instance_info_cache with network_info: [{"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Releasing lock "refresh_cache-147d9aee-cfd9-4e78-bf35-0ac7e16f6679" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG nova.objects.instance [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'migration_context' on Instance uuid 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG nova.objects.base [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Object Instance<147d9aee-cfd9-4e78-bf35-0ac7e16f6679> lazy-loaded attributes: info_cache,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.471s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26566343435383662', 'path': '/dev/sdf'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566343435383662', 'path': '/dev/sdf'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-444036208',display_name='tempest-TestVolumeBootPattern-server-444036208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-444036208',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxsC14B7FXvV2fSoMtlJDAqdPeFWveN/Z0Ifom/f6iLWm22eKeX4OVWWNojR/qqP5b5ZDw4QQNhLxzsgEQuPgfcqpGQNglCOOs11ACZVIFU1+eY4bhyAYc4WrWEkoqGQ==',key_name='tempest-TestVolumeBootPattern-2105905581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-upgw66sp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:14:46Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=d45e0bb0-526c-4940-a196-b21ff0589987,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "address": "fa:16:3e:41:de:20", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf581155c-2b", "ovs_interfaceid": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "address": "fa:16:3e:41:de:20", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf581155c-2b", "ovs_interfaceid": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:de:20,bridge_name='br-int',has_traffic_filtering=True,id=f581155c-2be9-4fa2-8e60-2fd067dfb38d,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf581155c-2b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.objects.instance [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'pci_devices' on Instance uuid d45e0bb0-526c-4940-a196-b21ff0589987 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:14:53 user nova-compute[75342]:   <uuid>d45e0bb0-526c-4940-a196-b21ff0589987</uuid>
Nov 16 18:14:53 user nova-compute[75342]:   <name>instance-00000024</name>
Nov 16 18:14:53 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:14:53 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:14:53 user nova-compute[75342]:   <metadata>
Nov 16 18:14:53 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:14:53 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:14:53 user nova-compute[75342]:       <nova:name>tempest-TestVolumeBootPattern-server-444036208</nova:name>
Nov 16 18:14:53 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:14:51</nova:creationTime>
Nov 16 18:14:53 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:14:53 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:14:53 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:14:53 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:14:53 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:14:53 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:14:53 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:14:53 user nova-compute[75342]:       <nova:owner>
Nov 16 18:14:53 user nova-compute[75342]:         <nova:user uuid="062cd6d338014493be6c40701d2a735b">tempest-TestVolumeBootPattern-312873750-project-member</nova:user>
Nov 16 18:14:53 user nova-compute[75342]:         <nova:project uuid="46d44dce2b444ef386b47927d5c70c8e">tempest-TestVolumeBootPattern-312873750</nova:project>
Nov 16 18:14:53 user nova-compute[75342]:       </nova:owner>
Nov 16 18:14:53 user nova-compute[75342]:       <nova:ports>
Nov 16 18:14:53 user nova-compute[75342]:         <nova:port uuid="f581155c-2be9-4fa2-8e60-2fd067dfb38d">
Nov 16 18:14:53 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 18:14:53 user nova-compute[75342]:         </nova:port>
Nov 16 18:14:53 user nova-compute[75342]:       </nova:ports>
Nov 16 18:14:53 user nova-compute[75342]:     </nova:instance>
Nov 16 18:14:53 user nova-compute[75342]:   </metadata>
Nov 16 18:14:53 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:14:53 user nova-compute[75342]:     <system>
Nov 16 18:14:53 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:14:53 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:14:53 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:14:53 user nova-compute[75342]:       <entry name="serial">d45e0bb0-526c-4940-a196-b21ff0589987</entry>
Nov 16 18:14:53 user nova-compute[75342]:       <entry name="uuid">d45e0bb0-526c-4940-a196-b21ff0589987</entry>
Nov 16 18:14:53 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:14:53 user nova-compute[75342]:     </system>
Nov 16 18:14:53 user nova-compute[75342]:   </sysinfo>
Nov 16 18:14:53 user nova-compute[75342]:   <os>
Nov 16 18:14:53 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:14:53 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:14:53 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:14:53 user nova-compute[75342]:   </os>
Nov 16 18:14:53 user nova-compute[75342]:   <features>
Nov 16 18:14:53 user nova-compute[75342]:     <acpi/>
Nov 16 18:14:53 user nova-compute[75342]:     <apic/>
Nov 16 18:14:53 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:14:53 user nova-compute[75342]:   </features>
Nov 16 18:14:53 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:14:53 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:14:53 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:14:53 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:14:53 user nova-compute[75342]:   </clock>
Nov 16 18:14:53 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:14:53 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:14:53 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:14:53 user nova-compute[75342]:   </cpu>
Nov 16 18:14:53 user nova-compute[75342]:   <devices>
Nov 16 18:14:53 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:14:53 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:14:53 user nova-compute[75342]:       <source dev="/dev/sdf"/>
Nov 16 18:14:53 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:14:53 user nova-compute[75342]:       <serial>f1b7789f-96b0-4cc3-9042-ad3199d965da</serial>
Nov 16 18:14:53 user nova-compute[75342]:     </disk>
Nov 16 18:14:53 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:14:53 user nova-compute[75342]:       <mac address="fa:16:3e:41:de:20"/>
Nov 16 18:14:53 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:14:53 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:14:53 user nova-compute[75342]:       <target dev="tapf581155c-2b"/>
Nov 16 18:14:53 user nova-compute[75342]:     </interface>
Nov 16 18:14:53 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:14:53 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/d45e0bb0-526c-4940-a196-b21ff0589987/console.log" append="off"/>
Nov 16 18:14:53 user nova-compute[75342]:     </serial>
Nov 16 18:14:53 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:14:53 user nova-compute[75342]:     <video>
Nov 16 18:14:53 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:14:53 user nova-compute[75342]:     </video>
Nov 16 18:14:53 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:14:53 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:14:53 user nova-compute[75342]:     </rng>
Nov 16 18:14:53 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:14:53 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:14:53 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:14:53 user nova-compute[75342]:     </memballoon>
Nov 16 18:14:53 user nova-compute[75342]:   </devices>
Nov 16 18:14:53 user nova-compute[75342]: </domain>
Nov 16 18:14:53 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-444036208',display_name='tempest-TestVolumeBootPattern-server-444036208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-444036208',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxsC14B7FXvV2fSoMtlJDAqdPeFWveN/Z0Ifom/f6iLWm22eKeX4OVWWNojR/qqP5b5ZDw4QQNhLxzsgEQuPgfcqpGQNglCOOs11ACZVIFU1+eY4bhyAYc4WrWEkoqGQ==',key_name='tempest-TestVolumeBootPattern-2105905581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-upgw66sp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:14:46Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=d45e0bb0-526c-4940-a196-b21ff0589987,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "address": "fa:16:3e:41:de:20", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf581155c-2b", "ovs_interfaceid": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "address": "fa:16:3e:41:de:20", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf581155c-2b", "ovs_interfaceid": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:de:20,bridge_name='br-int',has_traffic_filtering=True,id=f581155c-2be9-4fa2-8e60-2fd067dfb38d,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf581155c-2b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG os_vif [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:de:20,bridge_name='br-int',has_traffic_filtering=True,id=f581155c-2be9-4fa2-8e60-2fd067dfb38d,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf581155c-2b') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '074324a9-12b8-5189-baaa-8bd4755101d2', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf581155c-2b, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf581155c-2b, col_values=(('qos', UUID('457306c1-1e51-4822-87cc-d1e34b4b64d8')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf581155c-2b, col_values=(('external_ids', {'iface-id': 'f581155c-2be9-4fa2-8e60-2fd067dfb38d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:de:20', 'vm-uuid': 'd45e0bb0-526c-4940-a196-b21ff0589987'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:14:53 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Deleted allocation for migration da0b93a3-b601-4a82-bc33-7901e61b8390
Nov 16 18:14:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:53 user nova-compute[75342]: INFO os_vif [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:de:20,bridge_name='br-int',has_traffic_filtering=True,id=f581155c-2be9-4fa2-8e60-2fd067dfb38d,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf581155c-2b')
Nov 16 18:14:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-60aa6ced-b489-4610-9e46-ff937fedec4c tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.700s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:14:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No VIF found with MAC fa:16:3e:41:de:20, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:14:54 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:14:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:14:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:14:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:14:54 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:14:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Updating instance_info_cache with network_info: [{"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-f2869561-f314-44e4-b312-dd838e35c31a req-ff52fcfd-028a-442e-974c-e7654bb502ef service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Received event network-vif-plugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f2869561-f314-44e4-b312-dd838e35c31a req-ff52fcfd-028a-442e-974c-e7654bb502ef service nova] Acquiring lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f2869561-f314-44e4-b312-dd838e35c31a req-ff52fcfd-028a-442e-974c-e7654bb502ef service nova] Lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f2869561-f314-44e4-b312-dd838e35c31a req-ff52fcfd-028a-442e-974c-e7654bb502ef service nova] Lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-f2869561-f314-44e4-b312-dd838e35c31a req-ff52fcfd-028a-442e-974c-e7654bb502ef service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] No waiting events found dispatching network-vif-plugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:14:55 user nova-compute[75342]: WARNING nova.compute.manager [req-f2869561-f314-44e4-b312-dd838e35c31a req-ff52fcfd-028a-442e-974c-e7654bb502ef service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Received unexpected event network-vif-plugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d for instance with vm_state building and task_state spawning.
Nov 16 18:14:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-0c54066f-8fa7-4279-b62e-64614b01d6b1" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:14:57 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Instance spawned successfully.
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.compute.manager [req-3becf36f-7612-4ff7-91b5-76db04c1849d req-ab1808d5-c8ee-4318-a673-2bc4e7aa641e service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Received event network-vif-plugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3becf36f-7612-4ff7-91b5-76db04c1849d req-ab1808d5-c8ee-4318-a673-2bc4e7aa641e service nova] Acquiring lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3becf36f-7612-4ff7-91b5-76db04c1849d req-ab1808d5-c8ee-4318-a673-2bc4e7aa641e service nova] Lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3becf36f-7612-4ff7-91b5-76db04c1849d req-ab1808d5-c8ee-4318-a673-2bc4e7aa641e service nova] Lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.compute.manager [req-3becf36f-7612-4ff7-91b5-76db04c1849d req-ab1808d5-c8ee-4318-a673-2bc4e7aa641e service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] No waiting events found dispatching network-vif-plugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:14:57 user nova-compute[75342]: WARNING nova.compute.manager [req-3becf36f-7612-4ff7-91b5-76db04c1849d req-ab1808d5-c8ee-4318-a673-2bc4e7aa641e service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Received unexpected event network-vif-plugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d for instance with vm_state building and task_state spawning.
Nov 16 18:14:57 user nova-compute[75342]: INFO nova.compute.manager [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 16 18:14:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:14:57 user nova-compute[75342]: INFO nova.compute.manager [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Took 12.19 seconds to build instance.
Nov 16 18:14:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6b7eb642-a0d4-4300-ae98-fd05ef3ef0a0 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d45e0bb0-526c-4940-a196-b21ff0589987" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.295s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:14:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:14:59 user nova-compute[75342]: INFO nova.compute.manager [None req-9885d3ef-63ce-45bd-82f6-9f753bed00f6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Unrescuing
Nov 16 18:14:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9885d3ef-63ce-45bd-82f6-9f753bed00f6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:14:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9885d3ef-63ce-45bd-82f6-9f753bed00f6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquired lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:14:59 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9885d3ef-63ce-45bd-82f6-9f753bed00f6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:15:00 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9885d3ef-63ce-45bd-82f6-9f753bed00f6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Updating instance_info_cache with network_info: [{"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:15:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9885d3ef-63ce-45bd-82f6-9f753bed00f6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Releasing lock "refresh_cache-c82d7adf-64ed-4573-9b2f-58c1daab2651" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:15:00 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9885d3ef-63ce-45bd-82f6-9f753bed00f6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'flavor' on Instance uuid c82d7adf-64ed-4573-9b2f-58c1daab2651 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:15:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-9b7b5cd2-9581-4e75-89f8-382479f29e0d req-bdf79049-4d54-4464-bc86-9cd02e913dd5 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-unplugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9b7b5cd2-9581-4e75-89f8-382479f29e0d req-bdf79049-4d54-4464-bc86-9cd02e913dd5 service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9b7b5cd2-9581-4e75-89f8-382479f29e0d req-bdf79049-4d54-4464-bc86-9cd02e913dd5 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9b7b5cd2-9581-4e75-89f8-382479f29e0d req-bdf79049-4d54-4464-bc86-9cd02e913dd5 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-9b7b5cd2-9581-4e75-89f8-382479f29e0d req-bdf79049-4d54-4464-bc86-9cd02e913dd5 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-unplugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:00 user nova-compute[75342]: WARNING nova.compute.manager [req-9b7b5cd2-9581-4e75-89f8-382479f29e0d req-bdf79049-4d54-4464-bc86-9cd02e913dd5 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received unexpected event network-vif-unplugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Instance destroyed successfully.
Nov 16 18:15:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:02 user nova-compute[75342]: WARNING nova.compute.manager [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received unexpected event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:02 user nova-compute[75342]: WARNING nova.compute.manager [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received unexpected event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:02 user nova-compute[75342]: WARNING nova.compute.manager [req-90fdba43-69c2-487a-bb9c-1309991298be req-45ee3d23-8322-4b6d-8598-73399d5f154d service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received unexpected event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9885d3ef-63ce-45bd-82f6-9f753bed00f6 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:15:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:14 user nova-compute[75342]: INFO nova.compute.manager [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Unshelving
Nov 16 18:15:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:14 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'pci_requests' on Instance uuid 06eb90ec-da8e-46c1-9401-b9613ebe92c0 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:15:14 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'numa_topology' on Instance uuid 06eb90ec-da8e-46c1-9401-b9613ebe92c0 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:15:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:15:14 user nova-compute[75342]: INFO nova.compute.claims [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Claim successful on node user
Nov 16 18:15:14 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:15:14 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:15:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:14 user nova-compute[75342]: INFO nova.network.neutron [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updating port a81da486-f0aa-446c-8682-d37aea664738 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 18:15:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:15:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquired lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:15:15 user nova-compute[75342]: DEBUG nova.network.neutron [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:15:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-e670e8ba-c654-496f-b918-b4a069226caf req-2993a1a1-5dfe-4372-893d-33361ef4bac4 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-changed-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-e670e8ba-c654-496f-b918-b4a069226caf req-2993a1a1-5dfe-4372-893d-33361ef4bac4 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Refreshing instance network info cache due to event network-changed-a81da486-f0aa-446c-8682-d37aea664738. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:15:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e670e8ba-c654-496f-b918-b4a069226caf req-2993a1a1-5dfe-4372-893d-33361ef4bac4 service nova] Acquiring lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:15:16 user nova-compute[75342]: DEBUG nova.network.neutron [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updating instance_info_cache with network_info: [{"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:15:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Releasing lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:15:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:15:16 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Creating image(s)
Nov 16 18:15:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "/opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "/opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "/opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:16 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'trusted_certs' on Instance uuid 06eb90ec-da8e-46c1-9401-b9613ebe92c0 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:15:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e670e8ba-c654-496f-b918-b4a069226caf req-2993a1a1-5dfe-4372-893d-33361ef4bac4 service nova] Acquired lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:15:16 user nova-compute[75342]: DEBUG nova.network.neutron [req-e670e8ba-c654-496f-b918-b4a069226caf req-2993a1a1-5dfe-4372-893d-33361ef4bac4 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Refreshing network info cache for port a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:15:16 user nova-compute[75342]: DEBUG nova.objects.base [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Object Instance<06eb90ec-da8e-46c1-9401-b9613ebe92c0> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:15:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "2a9b07e1660ba764e92ec25f619a53505d71b710" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "2a9b07e1660ba764e92ec25f619a53505d71b710" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710.part --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:17 user nova-compute[75342]: DEBUG nova.virt.images [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] 4eb95d15-8d54-46cb-95b4-c8b41a896665 was qcow2, converting to raw {{(pid=75342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 18:15:17 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:15:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710.part /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710.converted {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:17 user nova-compute[75342]: DEBUG nova.network.neutron [req-e670e8ba-c654-496f-b918-b4a069226caf req-2993a1a1-5dfe-4372-893d-33361ef4bac4 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updated VIF entry in instance network info cache for port a81da486-f0aa-446c-8682-d37aea664738. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:15:17 user nova-compute[75342]: DEBUG nova.network.neutron [req-e670e8ba-c654-496f-b918-b4a069226caf req-2993a1a1-5dfe-4372-893d-33361ef4bac4 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updating instance_info_cache with network_info: [{"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:15:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e670e8ba-c654-496f-b918-b4a069226caf req-2993a1a1-5dfe-4372-893d-33361ef4bac4 service nova] Releasing lock "refresh_cache-06eb90ec-da8e-46c1-9401-b9613ebe92c0" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710.part /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710.converted" returned: 0 in 0.634s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710.converted --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "2a9b07e1660ba764e92ec25f619a53505d71b710" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.228s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710 --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "2a9b07e1660ba764e92ec25f619a53505d71b710" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "2a9b07e1660ba764e92ec25f619a53505d71b710" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710 --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710,backing_fmt=raw /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710,backing_fmt=raw /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk 1073741824" returned: 0 in 0.053s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "2a9b07e1660ba764e92ec25f619a53505d71b710" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710 --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'migration_context' on Instance uuid 06eb90ec-da8e-46c1-9401-b9613ebe92c0 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:15:18 user nova-compute[75342]: DEBUG nova.objects.base [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Object Instance<06eb90ec-da8e-46c1-9401-b9613ebe92c0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:15:19 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Rebasing disk image.
Nov 16 18:15:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.198s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d -F raw /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d -F raw /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk" returned: 0 in 2.376s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Ensure instance console log exists: /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Start _get_guest_xml network_info=[{"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c5f0233ca8b701388c1c4870605f731a',container_format='bare',created_at=2023-11-16T18:13:22Z,direct_url=<?>,disk_format='qcow2',id=4eb95d15-8d54-46cb-95b4-c8b41a896665,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1820588361-shelved',owner='2b314838880c4cf68c74b2a215fa0a78',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T18:13:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:15:21 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:15:21 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c5f0233ca8b701388c1c4870605f731a',container_format='bare',created_at=2023-11-16T18:13:22Z,direct_url=<?>,disk_format='qcow2',id=4eb95d15-8d54-46cb-95b4-c8b41a896665,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1820588361-shelved',owner='2b314838880c4cf68c74b2a215fa0a78',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T18:13:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'vcpu_model' on Instance uuid 06eb90ec-da8e-46c1-9401-b9613ebe92c0 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.objects.base [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Object Instance<06eb90ec-da8e-46c1-9401-b9613ebe92c0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1820588361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1820588361',id=33,image_ref='4eb95d15-8d54-46cb-95b4-c8b41a896665',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1106578881',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-wuca4hmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member',shelved_at='2023-11-16T18:13:26.307380',shelved_host='user',shelved_image_id='4eb95d15-8d54-46cb-95b4-c8b41a896665'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=06eb90ec-da8e-46c1-9401-b9613ebe92c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'pci_devices' on Instance uuid 06eb90ec-da8e-46c1-9401-b9613ebe92c0 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.objects.base [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Object Instance<06eb90ec-da8e-46c1-9401-b9613ebe92c0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:15:21 user nova-compute[75342]:   <uuid>06eb90ec-da8e-46c1-9401-b9613ebe92c0</uuid>
Nov 16 18:15:21 user nova-compute[75342]:   <name>instance-00000021</name>
Nov 16 18:15:21 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:15:21 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:15:21 user nova-compute[75342]:   <metadata>
Nov 16 18:15:21 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:15:21 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:15:21 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1820588361</nova:name>
Nov 16 18:15:21 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:15:21</nova:creationTime>
Nov 16 18:15:21 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:15:21 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:15:21 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:15:21 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:15:21 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:15:21 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:15:21 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:15:21 user nova-compute[75342]:       <nova:owner>
Nov 16 18:15:21 user nova-compute[75342]:         <nova:user uuid="5976cde7fade404fac5146e3952cc95f">tempest-AttachVolumeShelveTestJSON-1298817282-project-member</nova:user>
Nov 16 18:15:21 user nova-compute[75342]:         <nova:project uuid="2b314838880c4cf68c74b2a215fa0a78">tempest-AttachVolumeShelveTestJSON-1298817282</nova:project>
Nov 16 18:15:21 user nova-compute[75342]:       </nova:owner>
Nov 16 18:15:21 user nova-compute[75342]:       <nova:root type="image" uuid="4eb95d15-8d54-46cb-95b4-c8b41a896665"/>
Nov 16 18:15:21 user nova-compute[75342]:       <nova:ports>
Nov 16 18:15:21 user nova-compute[75342]:         <nova:port uuid="a81da486-f0aa-446c-8682-d37aea664738">
Nov 16 18:15:21 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 18:15:21 user nova-compute[75342]:         </nova:port>
Nov 16 18:15:21 user nova-compute[75342]:       </nova:ports>
Nov 16 18:15:21 user nova-compute[75342]:     </nova:instance>
Nov 16 18:15:21 user nova-compute[75342]:   </metadata>
Nov 16 18:15:21 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:15:21 user nova-compute[75342]:     <system>
Nov 16 18:15:21 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:15:21 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:15:21 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:15:21 user nova-compute[75342]:       <entry name="serial">06eb90ec-da8e-46c1-9401-b9613ebe92c0</entry>
Nov 16 18:15:21 user nova-compute[75342]:       <entry name="uuid">06eb90ec-da8e-46c1-9401-b9613ebe92c0</entry>
Nov 16 18:15:21 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:15:21 user nova-compute[75342]:     </system>
Nov 16 18:15:21 user nova-compute[75342]:   </sysinfo>
Nov 16 18:15:21 user nova-compute[75342]:   <os>
Nov 16 18:15:21 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:15:21 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:15:21 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:15:21 user nova-compute[75342]:   </os>
Nov 16 18:15:21 user nova-compute[75342]:   <features>
Nov 16 18:15:21 user nova-compute[75342]:     <acpi/>
Nov 16 18:15:21 user nova-compute[75342]:     <apic/>
Nov 16 18:15:21 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:15:21 user nova-compute[75342]:   </features>
Nov 16 18:15:21 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:15:21 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:15:21 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:15:21 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:15:21 user nova-compute[75342]:   </clock>
Nov 16 18:15:21 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:15:21 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:15:21 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:15:21 user nova-compute[75342]:   </cpu>
Nov 16 18:15:21 user nova-compute[75342]:   <devices>
Nov 16 18:15:21 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:15:21 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:15:21 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk"/>
Nov 16 18:15:21 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:15:21 user nova-compute[75342]:     </disk>
Nov 16 18:15:21 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:15:21 user nova-compute[75342]:       <mac address="fa:16:3e:cf:0b:65"/>
Nov 16 18:15:21 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:15:21 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:15:21 user nova-compute[75342]:       <target dev="tapa81da486-f0"/>
Nov 16 18:15:21 user nova-compute[75342]:     </interface>
Nov 16 18:15:21 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:15:21 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/console.log" append="off"/>
Nov 16 18:15:21 user nova-compute[75342]:     </serial>
Nov 16 18:15:21 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:15:21 user nova-compute[75342]:     <video>
Nov 16 18:15:21 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:15:21 user nova-compute[75342]:     </video>
Nov 16 18:15:21 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:15:21 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:15:21 user nova-compute[75342]:     </rng>
Nov 16 18:15:21 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:15:21 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:15:21 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:15:21 user nova-compute[75342]:     </memballoon>
Nov 16 18:15:21 user nova-compute[75342]:   </devices>
Nov 16 18:15:21 user nova-compute[75342]: </domain>
Nov 16 18:15:21 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1820588361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1820588361',id=33,image_ref='4eb95d15-8d54-46cb-95b4-c8b41a896665',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1106578881',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-wuca4hmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member',shelved_at='2023-11-16T18:13:26.307380',shelved_host='user',shelved_image_id='4eb95d15-8d54-46cb-95b4-c8b41a896665'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=06eb90ec-da8e-46c1-9401-b9613ebe92c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG os_vif [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bef00d9-2aec-5142-83bd-6ea66319bbb6', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa81da486-f0, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa81da486-f0, col_values=(('qos', UUID('658146e9-7b12-48e0-9b3e-c7de1f56533f')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa81da486-f0, col_values=(('external_ids', {'iface-id': 'a81da486-f0aa-446c-8682-d37aea664738', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:0b:65', 'vm-uuid': '06eb90ec-da8e-46c1-9401-b9613ebe92c0'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:21 user nova-compute[75342]: INFO os_vif [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0')
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:15:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] No VIF found with MAC fa:16:3e:cf:0b:65, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:15:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-831179d8-c069-4323-bb45-438ab271cc00 req-f86449a1-4855-4b12-ac0e-9fa588990259 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-831179d8-c069-4323-bb45-438ab271cc00 req-f86449a1-4855-4b12-ac0e-9fa588990259 service nova] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-831179d8-c069-4323-bb45-438ab271cc00 req-f86449a1-4855-4b12-ac0e-9fa588990259 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-831179d8-c069-4323-bb45-438ab271cc00 req-f86449a1-4855-4b12-ac0e-9fa588990259 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-831179d8-c069-4323-bb45-438ab271cc00 req-f86449a1-4855-4b12-ac0e-9fa588990259 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] No waiting events found dispatching network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:23 user nova-compute[75342]: WARNING nova.compute.manager [req-831179d8-c069-4323-bb45-438ab271cc00 req-f86449a1-4855-4b12-ac0e-9fa588990259 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received unexpected event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 18:15:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:24 user nova-compute[75342]: INFO nova.compute.manager [None req-bbfc4281-9f57-4f5e-80c4-56bd57b2d8bf tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Unrescuing
Nov 16 18:15:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bbfc4281-9f57-4f5e-80c4-56bd57b2d8bf tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bbfc4281-9f57-4f5e-80c4-56bd57b2d8bf tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquired lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bbfc4281-9f57-4f5e-80c4-56bd57b2d8bf tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG nova.network.neutron [None req-bbfc4281-9f57-4f5e-80c4-56bd57b2d8bf tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updating instance_info_cache with network_info: [{"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bbfc4281-9f57-4f5e-80c4-56bd57b2d8bf tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Releasing lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG nova.objects.instance [None req-bbfc4281-9f57-4f5e-80c4-56bd57b2d8bf tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'flavor' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-31beaf02-793e-4afe-a0ae-a0d01b812d02 req-b221e0c4-0efe-4d59-a917-ea0d23c49f8c service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31beaf02-793e-4afe-a0ae-a0d01b812d02 req-b221e0c4-0efe-4d59-a917-ea0d23c49f8c service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31beaf02-793e-4afe-a0ae-a0d01b812d02 req-b221e0c4-0efe-4d59-a917-ea0d23c49f8c service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-31beaf02-793e-4afe-a0ae-a0d01b812d02 req-b221e0c4-0efe-4d59-a917-ea0d23c49f8c service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-31beaf02-793e-4afe-a0ae-a0d01b812d02 req-b221e0c4-0efe-4d59-a917-ea0d23c49f8c service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:24 user nova-compute[75342]: WARNING nova.compute.manager [req-31beaf02-793e-4afe-a0ae-a0d01b812d02 req-b221e0c4-0efe-4d59-a917-ea0d23c49f8c service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG nova.compute.manager [req-47bb4cff-a9cb-4274-9a12-0bd56e187435 req-e58e7032-74e8-44ba-8767-ada8536f44ed service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-47bb4cff-a9cb-4274-9a12-0bd56e187435 req-e58e7032-74e8-44ba-8767-ada8536f44ed service nova] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-47bb4cff-a9cb-4274-9a12-0bd56e187435 req-e58e7032-74e8-44ba-8767-ada8536f44ed service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-47bb4cff-a9cb-4274-9a12-0bd56e187435 req-e58e7032-74e8-44ba-8767-ada8536f44ed service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG nova.compute.manager [req-47bb4cff-a9cb-4274-9a12-0bd56e187435 req-e58e7032-74e8-44ba-8767-ada8536f44ed service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] No waiting events found dispatching network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:25 user nova-compute[75342]: WARNING nova.compute.manager [req-47bb4cff-a9cb-4274-9a12-0bd56e187435 req-e58e7032-74e8-44ba-8767-ada8536f44ed service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received unexpected event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 18:15:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG nova.compute.manager [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:15:25 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Instance spawned successfully.
Nov 16 18:15:25 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Instance destroyed successfully.
Nov 16 18:15:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG nova.compute.manager [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e982d6b-a1cd-4d80-9a11-e85de27754f2 tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.491s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:26 user nova-compute[75342]: WARNING nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:26 user nova-compute[75342]: WARNING nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:26 user nova-compute[75342]: WARNING nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:26 user nova-compute[75342]: WARNING nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:26 user nova-compute[75342]: DEBUG nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:26 user nova-compute[75342]: WARNING nova.compute.manager [req-355a6b21-42bd-4467-9941-eac8f55928b4 req-cb577521-8676-4569-9dc2-2c8a38bcca1e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:28 user nova-compute[75342]: WARNING nova.compute.manager [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:28 user nova-compute[75342]: WARNING nova.compute.manager [req-6036c1b7-edc4-4cab-a44a-def8c4d2a8c5 req-ff97cd8e-71c0-4817-b48c-eb19da4adb5b service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:15:29 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bbfc4281-9f57-4f5e-80c4-56bd57b2d8bf tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:15:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-8553d0af-f8d3-4542-b2c4-a6968876c192 req-789df6b9-632e-4c4d-9b76-521c96662200 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-changed-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-8553d0af-f8d3-4542-b2c4-a6968876c192 req-789df6b9-632e-4c4d-9b76-521c96662200 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Refreshing instance network info cache due to event network-changed-1f0e212f-0cb1-47be-b27f-90feb2b3568f. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8553d0af-f8d3-4542-b2c4-a6968876c192 req-789df6b9-632e-4c4d-9b76-521c96662200 service nova] Acquiring lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8553d0af-f8d3-4542-b2c4-a6968876c192 req-789df6b9-632e-4c4d-9b76-521c96662200 service nova] Acquired lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG nova.network.neutron [req-8553d0af-f8d3-4542-b2c4-a6968876c192 req-789df6b9-632e-4c4d-9b76-521c96662200 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Refreshing network info cache for port 1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:41 user nova-compute[75342]: INFO nova.compute.manager [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Terminating instance
Nov 16 18:15:41 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG nova.network.neutron [req-8553d0af-f8d3-4542-b2c4-a6968876c192 req-789df6b9-632e-4c4d-9b76-521c96662200 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updated VIF entry in instance network info cache for port 1f0e212f-0cb1-47be-b27f-90feb2b3568f. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG nova.network.neutron [req-8553d0af-f8d3-4542-b2c4-a6968876c192 req-789df6b9-632e-4c4d-9b76-521c96662200 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating instance_info_cache with network_info: [{"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:15:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8553d0af-f8d3-4542-b2c4-a6968876c192 req-789df6b9-632e-4c4d-9b76-521c96662200 service nova] Releasing lock "refresh_cache-d4c63c32-8406-4498-b4de-8e8ecbc2a173" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:15:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Instance destroyed successfully.
Nov 16 18:15:42 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lazy-loading 'resources' on Instance uuid d4c63c32-8406-4498-b4de-8e8ecbc2a173 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1011058480',display_name='tempest-TestShelveInstance-server-1011058480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1011058480',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiiI+Kbr7I++Ar7wZEVjMsGCaGZwXXvpVLemr4oPu6KcP5xOWW79PL8S3X7CGkmsoOgFJC/vOfwrrHTdTdEv1aDgavC1XoGmY0sba3f9D0T3rFUcp79le5MDwQtusWxOQ==',key_name='tempest-TestShelveInstance-2005458468',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf819660602345c6acdb1caeff5bf347',ramdisk_id='',reservation_id='r-tij2s1qg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2088508252',owner_user_name='tempest-TestShelveInstance-2088508252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:14:03Z,user_data=None,user_id='ba8b928d71ce4f918f0d5d6bd78b0ebb',uuid=d4c63c32-8406-4498-b4de-8e8ecbc2a173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converting VIF {"id": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "address": "fa:16:3e:88:5e:82", "network": {"id": "c1916770-5b17-41cd-9016-308a9b390827", "bridge": "br-int", "label": "tempest-TestShelveInstance-1924207506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf819660602345c6acdb1caeff5bf347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f0e212f-0c", "ovs_interfaceid": "1f0e212f-0cb1-47be-b27f-90feb2b3568f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_vif [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f0e212f-0c, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c666d57b-7332-4f87-a450-b59345a5428d) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:15:42 user nova-compute[75342]: INFO os_vif [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1f0e212f-0cb1-47be-b27f-90feb2b3568f,network=Network(c1916770-5b17-41cd-9016-308a9b390827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f0e212f-0c')
Nov 16 18:15:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlBGrdDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:15:42 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb27c80e-50a4-4d87-af6d-a22d6a7224dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:15:42 user nova-compute[75342]: No targets found.
Nov 16 18:15:42 user nova-compute[75342]: iSNS:
Nov 16 18:15:42 user nova-compute[75342]: No targets found.
Nov 16 18:15:42 user nova-compute[75342]: STATIC:
Nov 16 18:15:42 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:15:42 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:15:42 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:15:42 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8
Nov 16 18:15:42 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:15:42 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:15:42 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519
Nov 16 18:15:42 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:15:42 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:15:42 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:15:42 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:15:42 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:15:42 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da
Nov 16 18:15:42 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:15:42 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:15:42 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b
Nov 16 18:15:42 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:15:42 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:15:42 user nova-compute[75342]: FIRMWARE:
Nov 16 18:15:42 user nova-compute[75342]: No targets found.
Nov 16 18:15:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:15:42 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:15:42 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacf293a-f088-426b-8955-d1530c978f5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bf0407-78c2-4ddd-96a7-08ba880571bb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:15:42 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:15:42 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:15:42 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:15:42 user nova-compute[75342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:15:42 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:15:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:15:42 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:15:42 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:15:42 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:15:42 user nova-compute[75342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 (non-flash)
Nov 16 18:15:42 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:15:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a452f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519'): ({'sdc'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Removing single pathed devices sdc {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce8874-e519-43a9-9bb3-80b20697d709]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3076c-2e64-4c3f-b7b9-e51163a4f8db]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Flushing IO for device /dev/sdc {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a4f683-0caa-4e08-8b6e-1fadf7baa8bb]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97381ac7-7fd0-4ab8-8583-23cfc0671a57]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b727f2c3', '/dev/disk/by-id/scsi-23738626534666266', '/dev/disk/by-id/scsi-1SCST_BIOb727f2c3-78be4fbf880dcffd') {{(pid=85570) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82bc517-bebe-47e0-9afb-87ad70edb210]: (4, None) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4913115-dce0-424b-b561-755862cfdb61]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0193dc-dc0e-43b8-b799-5d35a6255545]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260]
Nov 16 18:15:42 user nova-compute[75342]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519, portal: 172.16.0.220,3260] successful.
Nov 16 18:15:42 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6258ccc-4998-46d4-b129-99252c6e5519 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4c114b-a794-4f76-938e-ee91af62180e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] <== disconnect_volume: return (344ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:15:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Deleting instance files /opt/stack/data/nova/instances/d4c63c32-8406-4498-b4de-8e8ecbc2a173_del
Nov 16 18:15:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Deletion of /opt/stack/data/nova/instances/d4c63c32-8406-4498-b4de-8e8ecbc2a173_del complete
Nov 16 18:15:42 user nova-compute[75342]: INFO nova.compute.manager [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 16 18:15:42 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:15:42 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:15:42 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Took 0.42 seconds to deallocate network for instance.
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] There are 0 instances to clean {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-unplugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] Acquiring lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] No waiting events found dispatching network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:15:43 user nova-compute[75342]: WARNING nova.compute.manager [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received unexpected event network-vif-plugged-1f0e212f-0cb1-47be-b27f-90feb2b3568f for instance with vm_state active and task_state deleting.
Nov 16 18:15:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-524ca009-816b-4eb6-9833-5daf092e5b75 req-d802d877-77ed-4ea4-8c30-cfc871714787 service nova] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Received event network-vif-deleted-1f0e212f-0cb1-47be-b27f-90feb2b3568f {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:43 user nova-compute[75342]: INFO nova.compute.manager [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Took 0.73 seconds to detach 1 volumes for instance.
Nov 16 18:15:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] [instance: d4c63c32-8406-4498-b4de-8e8ecbc2a173] Deleting volume: a6258ccc-4998-46d4-b129-99252c6e5519 {{(pid=75342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:44 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:15:44 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:15:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:44 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Deleted allocations for instance d4c63c32-8406-4498-b4de-8e8ecbc2a173
Nov 16 18:15:44 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c80ee26-c862-4c26-813f-f687d8c2c6fd tempest-TestShelveInstance-2088508252 tempest-TestShelveInstance-2088508252-project-member] Lock "d4c63c32-8406-4498-b4de-8e8ecbc2a173" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.049s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:45 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:46 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:15:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:15:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:15:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:15:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7078MB free_disk=24.966094970703125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 120e116f-a0e5-406c-9883-6f173da89100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c82d7adf-64ed-4573-9b2f-58c1daab2651 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c53c3ddf-a478-4692-81b0-1b3e403f0cea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d45e0bb0-526c-4940-a196-b21ff0589987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 06eb90ec-da8e-46c1-9401-b9613ebe92c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing inventories for resource provider fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating ProviderTree inventory for provider fdd6b940-75a0-4315-8416-79157aaeea59 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 18:15:51 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 18:15:52 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing aggregate associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, aggregates: None {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 18:15:52 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing trait associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, traits: COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 18:15:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:52 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:15:52 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:15:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:15:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.873s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:15:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:54 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:54 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:15:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:15:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:15:54 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:15:55 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Updating instance_info_cache with network_info: [{"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:15:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-78afab8c-3e7c-4697-86b8-726c6ed252c5" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:15:55 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:15:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:15:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:15:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 85cd3e12-187f-48ba-9753-e8e93787cdf4 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 0c54066f-8fa7-4279-b62e-64614b01d6b1 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 78afab8c-3e7c-4697-86b8-726c6ed252c5 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid d0385123-12ff-41a3-a78d-ac5ce325ae0d {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 120e116f-a0e5-406c-9883-6f173da89100 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid c82d7adf-64ed-4573-9b2f-58c1daab2651 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid c53c3ddf-a478-4692-81b0-1b3e403f0cea {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid d45e0bb0-526c-4940-a196-b21ff0589987 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 06eb90ec-da8e-46c1-9401-b9613ebe92c0 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "120e116f-a0e5-406c-9883-6f173da89100" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "120e116f-a0e5-406c-9883-6f173da89100" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "d45e0bb0-526c-4940-a196-b21ff0589987" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "d45e0bb0-526c-4940-a196-b21ff0589987" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "120e116f-a0e5-406c-9883-6f173da89100" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "d45e0bb0-526c-4940-a196-b21ff0589987" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-6e32fd98-4b8c-4169-b186-34077d857de9 req-e024c93d-2707-4af0-8b7a-324662e5a29e service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Received event network-changed-b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:16:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-6e32fd98-4b8c-4169-b186-34077d857de9 req-e024c93d-2707-4af0-8b7a-324662e5a29e service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Refreshing instance network info cache due to event network-changed-b1c08917-dbca-468f-92ac-12cdf2c61fc5. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:16:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6e32fd98-4b8c-4169-b186-34077d857de9 req-e024c93d-2707-4af0-8b7a-324662e5a29e service nova] Acquiring lock "refresh_cache-c53c3ddf-a478-4692-81b0-1b3e403f0cea" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:16:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6e32fd98-4b8c-4169-b186-34077d857de9 req-e024c93d-2707-4af0-8b7a-324662e5a29e service nova] Acquired lock "refresh_cache-c53c3ddf-a478-4692-81b0-1b3e403f0cea" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:16:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-6e32fd98-4b8c-4169-b186-34077d857de9 req-e024c93d-2707-4af0-8b7a-324662e5a29e service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Refreshing network info cache for port b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-6e32fd98-4b8c-4169-b186-34077d857de9 req-e024c93d-2707-4af0-8b7a-324662e5a29e service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Updated VIF entry in instance network info cache for port b1c08917-dbca-468f-92ac-12cdf2c61fc5. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-6e32fd98-4b8c-4169-b186-34077d857de9 req-e024c93d-2707-4af0-8b7a-324662e5a29e service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Updating instance_info_cache with network_info: [{"id": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "address": "fa:16:3e:b6:12:d4", "network": {"id": "ca4da789-6833-4b42-bbb2-d90a38f7e1b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110095711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2189db5a95468dbf66c195eb817345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c08917-db", "ovs_interfaceid": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6e32fd98-4b8c-4169-b186-34077d857de9 req-e024c93d-2707-4af0-8b7a-324662e5a29e service nova] Releasing lock "refresh_cache-c53c3ddf-a478-4692-81b0-1b3e403f0cea" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG nova.objects.instance [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lazy-loading 'flavor' on Instance uuid c53c3ddf-a478-4692-81b0-1b3e403f0cea {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:07 user nova-compute[75342]: INFO nova.compute.manager [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Attaching volume 8a3e0109-5138-44cc-9cd3-ee26efa7d717 to /dev/vdb
Nov 16 18:16:07 user nova-compute[75342]: DEBUG os_brick.utils [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af44b4b-974d-4f87-b704-c2c05a7e2b57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cfdf75-4d4b-4794-adf3-37f256e5c68a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f0f343-164c-4395-bf4c-0fda3e07364e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad8d2b2-c0fc-4913-bd23-4dcf0ad2cf0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:16:07 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:16:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe7c900-0319-43ed-beee-ba48839b76b1]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG os_brick.utils [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:16:07 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Updating existing volume attachment record: 94816ede-d649-4670-8e67-089cb650664d {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:16:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbVDciSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:16:13 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:16:13 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:16:13 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97258674-a790-4d4b-a473-62dac345379a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:16:13 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfddcb7f-782d-4d4f-a7c3-2f9d02f3a970]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717] added
Nov 16 18:16:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f54960-55ac-494f-b426-467a5b41f026]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5888df05-698f-4dca-9055-4ccc87c4fc95]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qbVDciSy {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qbVDciSy" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f497b16b-268b-4d71-9446-ce811f227c08]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qbVDciSy'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[12107d82-8af4-4035-8289-ce88935563a4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fe869e-0d63-4df0-967a-f90da7b1708e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:16:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:16:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d80f35-55a3-4091-bb4a-dc1f67d8d5d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717, portal: 172.16.0.220,3260]
Nov 16 18:16:13 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717, portal: 172.16.0.220,3260] successful.
Nov 16 18:16:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[52967801-5b90-439c-8810-857911481c59]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edc8c20-4750-488f-a4ea-7111e0d3dd3f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:16:13 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92b4f90-0b6b-4180-94a7-da4fc51ee3c4]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbVDciSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:16:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:16:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23562633664636161', 'path': '/dev/sdc'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:16:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562633664636161', 'path': '/dev/sdc'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:16:14 user nova-compute[75342]: DEBUG nova.objects.instance [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lazy-loading 'flavor' on Instance uuid c53c3ddf-a478-4692-81b0-1b3e403f0cea {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:16:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:16:14 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:16:14 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:16:14 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:16:14 user nova-compute[75342]:   <serial>8a3e0109-5138-44cc-9cd3-ee26efa7d717</serial>
Nov 16 18:16:14 user nova-compute[75342]: </disk>
Nov 16 18:16:14 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:16:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:16:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:16:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] No VIF found with MAC fa:16:3e:b6:12:d4, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:16:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e1601c02-d9f6-47cb-bae1-f0f59213f45a tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.368s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:17 user nova-compute[75342]: DEBUG nova.objects.instance [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lazy-loading 'flavor' on Instance uuid c53c3ddf-a478-4692-81b0-1b3e403f0cea {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:16:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:17 user nova-compute[75342]: INFO nova.compute.manager [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Attaching volume 72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 to /dev/vdc
Nov 16 18:16:18 user nova-compute[75342]: DEBUG os_brick.utils [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c452e4-7320-4d83-ab2e-3f1653d41e31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaafc17-f061-42b8-a024-8cee67669c5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d0029f-b73b-4840-993a-a934e6cee55e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4433c48b-4ac8-4b2f-9ab3-eeca3d12bdaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:16:18 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:16:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcad8132-2f5b-425a-9a37-66e00252c2a7]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG os_brick.utils [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:16:18 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Updating existing volume attachment record: fea630d0-4d2c-49d1-9966-cf72498ae8e8 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:16:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWfMYnoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:16:23 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:16:23 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:16:23 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3f43d0-db3b-4ae5-b4b8-d26c4f0c4ab5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:16:23 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65a499e-4051-4eef-86d0-89ec1453d582]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6] added
Nov 16 18:16:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dce5e73-07e6-4b80-b8b6-eaecab57524e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87b9a88-3046-4f58-91b1-ab976f7629f7]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWfMYnoU {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWfMYnoU" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f49994d-deec-463a-9b15-485d046e778d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWfMYnoU'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1801c873-e3ed-4728-a97a-3362a1b4e964]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a76c181-10fc-45e1-914d-b3b12a0b1e75]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc49618-39b5-4e52-9f99-0a213bbf002f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6, portal: 172.16.0.220,3260]
Nov 16 18:16:23 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6, portal: 172.16.0.220,3260] successful.
Nov 16 18:16:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37169b2-3d06-4f53-89b9-b764dbc92bf1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8003fa3f-c722-44a1-85e7-23bf6f1e6d10]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 (non-flash)
Nov 16 18:16:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] HCTL ('38', '-', '-', 0) found on session 44 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4b9d0f-4621-48fa-af85-04444e24b6c0]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:16:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:16:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWfMYnoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:16:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:16:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26233393838346330', 'path': '/dev/sdg'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:16:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233393838346330', 'path': '/dev/sdg'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:16:24 user nova-compute[75342]: DEBUG nova.objects.instance [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lazy-loading 'flavor' on Instance uuid c53c3ddf-a478-4692-81b0-1b3e403f0cea {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:16:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:16:24 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:16:24 user nova-compute[75342]:   <source dev="/dev/sdg"/>
Nov 16 18:16:24 user nova-compute[75342]:   <target dev="vdc" bus="virtio"/>
Nov 16 18:16:24 user nova-compute[75342]:   <serial>72ec4577-fc24-46c0-a9e9-22dd6bf74ed6</serial>
Nov 16 18:16:24 user nova-compute[75342]: </disk>
Nov 16 18:16:24 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:16:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:16:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:16:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:16:25 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] No VIF found with MAC fa:16:3e:b6:12:d4, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:16:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-93bbaeed-6ab8-4b67-8abd-fe57da9a30d3 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.621s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:26 user nova-compute[75342]: INFO nova.compute.manager [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Detaching volume 72ec4577-fc24-46c0-a9e9-22dd6bf74ed6
Nov 16 18:16:26 user nova-compute[75342]: INFO nova.virt.block_device [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Attempting to driver detach volume 72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 from mountpoint /dev/vdc
Nov 16 18:16:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Attempting to detach device vdc from instance c53c3ddf-a478-4692-81b0-1b3e403f0cea from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:16:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:16:26 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:16:26 user nova-compute[75342]:   <source dev="/dev/sdg"/>
Nov 16 18:16:26 user nova-compute[75342]:   <target dev="vdc" bus="virtio"/>
Nov 16 18:16:26 user nova-compute[75342]:   <serial>72ec4577-fc24-46c0-a9e9-22dd6bf74ed6</serial>
Nov 16 18:16:26 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 18:16:26 user nova-compute[75342]: </disk>
Nov 16 18:16:26 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:16:26 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Successfully detached device vdc from instance c53c3ddf-a478-4692-81b0-1b3e403f0cea from the persistent domain config.
Nov 16 18:16:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c53c3ddf-a478-4692-81b0-1b3e403f0cea from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:16:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:16:26 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:16:26 user nova-compute[75342]:   <source dev="/dev/sdg"/>
Nov 16 18:16:26 user nova-compute[75342]:   <target dev="vdc" bus="virtio"/>
Nov 16 18:16:26 user nova-compute[75342]:   <serial>72ec4577-fc24-46c0-a9e9-22dd6bf74ed6</serial>
Nov 16 18:16:26 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 18:16:26 user nova-compute[75342]: </disk>
Nov 16 18:16:26 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:16:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c53c3ddf-a478-4692-81b0-1b3e403f0cea {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:16:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:16:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:36 user nova-compute[75342]: INFO nova.compute.manager [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Terminating instance
Nov 16 18:16:36 user nova-compute[75342]: DEBUG nova.compute.manager [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:16:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-9130ac49-9064-4bda-94ac-5299db75a3c4 req-8fa6c24d-b919-4b2d-a458-a01f8cb33739 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-unplugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9130ac49-9064-4bda-94ac-5299db75a3c4 req-8fa6c24d-b919-4b2d-a458-a01f8cb33739 service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9130ac49-9064-4bda-94ac-5299db75a3c4 req-8fa6c24d-b919-4b2d-a458-a01f8cb33739 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9130ac49-9064-4bda-94ac-5299db75a3c4 req-8fa6c24d-b919-4b2d-a458-a01f8cb33739 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-9130ac49-9064-4bda-94ac-5299db75a3c4 req-8fa6c24d-b919-4b2d-a458-a01f8cb33739 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-unplugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-9130ac49-9064-4bda-94ac-5299db75a3c4 req-8fa6c24d-b919-4b2d-a458-a01f8cb33739 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-unplugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:16:37 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Instance destroyed successfully.
Nov 16 18:16:37 user nova-compute[75342]: DEBUG nova.objects.instance [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'resources' on Instance uuid 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2074580807',display_name='tempest-AttachVolumeTestJSON-server-2074580807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2074580807',id=25,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPFfdYGYtdfUwjEiOE/iwsDZ8HxFnxrUjMrOXe3mcWU8NAzXmZ0SHoyGfYP5VBo3S4o53/E3MwQVBkBzuKmzbRAXUrMsihBETp/TApLvk6647LfkR70K66wWqQJP/b4A==',key_name='tempest-keypair-1267583389',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-pms15lgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=361ee32d-4ad3-4bd3-bdf9-6fd404d0f297,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "address": "fa:16:3e:3f:c1:5a", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326f6a9c-15", "ovs_interfaceid": "326f6a9c-1559-4846-b2df-cb6b8ac9eed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG os_vif [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap326f6a9c-15, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e1682a7-7ef3-4ea6-be20-f083066646b8) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:16:37 user nova-compute[75342]: INFO os_vif [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c1:5a,bridge_name='br-int',has_traffic_filtering=True,id=326f6a9c-1559-4846-b2df-cb6b8ac9eed9,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326f6a9c-15')
Nov 16 18:16:37 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Deleting instance files /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297_del
Nov 16 18:16:37 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Deletion of /opt/stack/data/nova/instances/361ee32d-4ad3-4bd3-bdf9-6fd404d0f297_del complete
Nov 16 18:16:37 user nova-compute[75342]: INFO nova.compute.manager [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 18:16:37 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:16:37 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-3b4bf653-84f5-46f8-866e-4f04c778fc90 req-f8c4dc48-7096-4f59-9fe0-9784dd3769ee service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Received event network-changed-f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-3b4bf653-84f5-46f8-866e-4f04c778fc90 req-f8c4dc48-7096-4f59-9fe0-9784dd3769ee service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Refreshing instance network info cache due to event network-changed-f581155c-2be9-4fa2-8e60-2fd067dfb38d. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3b4bf653-84f5-46f8-866e-4f04c778fc90 req-f8c4dc48-7096-4f59-9fe0-9784dd3769ee service nova] Acquiring lock "refresh_cache-d45e0bb0-526c-4940-a196-b21ff0589987" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3b4bf653-84f5-46f8-866e-4f04c778fc90 req-f8c4dc48-7096-4f59-9fe0-9784dd3769ee service nova] Acquired lock "refresh_cache-d45e0bb0-526c-4940-a196-b21ff0589987" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG nova.network.neutron [req-3b4bf653-84f5-46f8-866e-4f04c778fc90 req-f8c4dc48-7096-4f59-9fe0-9784dd3769ee service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Refreshing network info cache for port f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "d45e0bb0-526c-4940-a196-b21ff0589987" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d45e0bb0-526c-4940-a196-b21ff0589987" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:38 user nova-compute[75342]: INFO nova.compute.manager [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Terminating instance
Nov 16 18:16:38 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG nova.network.neutron [req-3b4bf653-84f5-46f8-866e-4f04c778fc90 req-f8c4dc48-7096-4f59-9fe0-9784dd3769ee service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Updated VIF entry in instance network info cache for port f581155c-2be9-4fa2-8e60-2fd067dfb38d. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG nova.network.neutron [req-3b4bf653-84f5-46f8-866e-4f04c778fc90 req-f8c4dc48-7096-4f59-9fe0-9784dd3769ee service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Updating instance_info_cache with network_info: [{"id": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "address": "fa:16:3e:41:de:20", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf581155c-2b", "ovs_interfaceid": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3b4bf653-84f5-46f8-866e-4f04c778fc90 req-f8c4dc48-7096-4f59-9fe0-9784dd3769ee service nova] Releasing lock "refresh_cache-d45e0bb0-526c-4940-a196-b21ff0589987" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:16:38 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Took 1.24 seconds to deallocate network for instance.
Nov 16 18:16:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-8a44c67b-eba0-4a28-b641-b6d4edb6cf36 req-90e2c422-cfdd-41e9-9fe2-0998305c702e service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Received event network-vif-unplugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8a44c67b-eba0-4a28-b641-b6d4edb6cf36 req-90e2c422-cfdd-41e9-9fe2-0998305c702e service nova] Acquiring lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8a44c67b-eba0-4a28-b641-b6d4edb6cf36 req-90e2c422-cfdd-41e9-9fe2-0998305c702e service nova] Lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8a44c67b-eba0-4a28-b641-b6d4edb6cf36 req-90e2c422-cfdd-41e9-9fe2-0998305c702e service nova] Lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-8a44c67b-eba0-4a28-b641-b6d4edb6cf36 req-90e2c422-cfdd-41e9-9fe2-0998305c702e service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] No waiting events found dispatching network-vif-unplugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-8a44c67b-eba0-4a28-b641-b6d4edb6cf36 req-90e2c422-cfdd-41e9-9fe2-0998305c702e service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Received event network-vif-unplugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-8781d293-916d-4219-a087-cc066c459750 req-e7fa5fe7-8a4a-47e8-97ea-f1211e683549 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8781d293-916d-4219-a087-cc066c459750 req-e7fa5fe7-8a4a-47e8-97ea-f1211e683549 service nova] Acquiring lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8781d293-916d-4219-a087-cc066c459750 req-e7fa5fe7-8a4a-47e8-97ea-f1211e683549 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8781d293-916d-4219-a087-cc066c459750 req-e7fa5fe7-8a4a-47e8-97ea-f1211e683549 service nova] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-8781d293-916d-4219-a087-cc066c459750 req-e7fa5fe7-8a4a-47e8-97ea-f1211e683549 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] No waiting events found dispatching network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:16:39 user nova-compute[75342]: WARNING nova.compute.manager [req-8781d293-916d-4219-a087-cc066c459750 req-e7fa5fe7-8a4a-47e8-97ea-f1211e683549 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received unexpected event network-vif-plugged-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 for instance with vm_state deleted and task_state None.
Nov 16 18:16:39 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:16:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Instance destroyed successfully.
Nov 16 18:16:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'resources' on Instance uuid d45e0bb0-526c-4940-a196-b21ff0589987 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-444036208',display_name='tempest-TestVolumeBootPattern-server-444036208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-444036208',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxsC14B7FXvV2fSoMtlJDAqdPeFWveN/Z0Ifom/f6iLWm22eKeX4OVWWNojR/qqP5b5ZDw4QQNhLxzsgEQuPgfcqpGQNglCOOs11ACZVIFU1+eY4bhyAYc4WrWEkoqGQ==',key_name='tempest-TestVolumeBootPattern-2105905581',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:14:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-upgw66sp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:14:57Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=d45e0bb0-526c-4940-a196-b21ff0589987,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "address": "fa:16:3e:41:de:20", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf581155c-2b", "ovs_interfaceid": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "address": "fa:16:3e:41:de:20", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf581155c-2b", "ovs_interfaceid": "f581155c-2be9-4fa2-8e60-2fd067dfb38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:de:20,bridge_name='br-int',has_traffic_filtering=True,id=f581155c-2be9-4fa2-8e60-2fd067dfb38d,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf581155c-2b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_vif [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:de:20,bridge_name='br-int',has_traffic_filtering=True,id=f581155c-2be9-4fa2-8e60-2fd067dfb38d,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf581155c-2b') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf581155c-2b, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=457306c1-1e51-4822-87cc-d1e34b4b64d8) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:39 user nova-compute[75342]: INFO os_vif [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:de:20,bridge_name='br-int',has_traffic_filtering=True,id=f581155c-2be9-4fa2-8e60-2fd067dfb38d,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf581155c-2b')
Nov 16 18:16:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAElFIVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:16:39 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:39 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Deleted allocations for instance 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eefb17-f2af-4742-b359-98848d0383c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:16:39 user nova-compute[75342]: No targets found.
Nov 16 18:16:39 user nova-compute[75342]: iSNS:
Nov 16 18:16:39 user nova-compute[75342]: No targets found.
Nov 16 18:16:39 user nova-compute[75342]: STATIC:
Nov 16 18:16:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:16:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8
Nov 16 18:16:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:16:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717
Nov 16 18:16:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da
Nov 16 18:16:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b
Nov 16 18:16:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6
Nov 16 18:16:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:39 user nova-compute[75342]: FIRMWARE:
Nov 16 18:16:39 user nova-compute[75342]: No targets found.
Nov 16 18:16:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:16:39 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:16:39 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8261049a-c1e7-4859-8b42-3523aa96b4a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[21822f03-5a6d-47b1-9458-1da515c5289c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 (non-flash)
Nov 16 18:16:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:39 user nova-compute[75342]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 (non-flash)
Nov 16 18:16:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a466ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da'): ({'sdf'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Removing single pathed devices sdf {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-505b7d8a-09c1-477c-b656-fd4084e7876b tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "361ee32d-4ad3-4bd3-bdf9-6fd404d0f297" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.830s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9608dd6-c703-498f-aad2-3c9f214d7b43]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fd1a41-0f04-4124-82cc-75a758c1a166]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flushing IO for device /dev/sdf {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4bcfdb-1a67-49b8-9e8c-67012d982b53]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35e1a0d-a513-446e-843a-4729e7a72f5c]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] SCSI volumes sdf have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc843858-3478-4243-b166-c589a71fe111]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd793fd5-6f92-4e54-8cfb-915c27a9dc38]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260]
Nov 16 18:16:39 user nova-compute[75342]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260] successful.
Nov 16 18:16:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e91aa6-786c-430e-a4fc-4c3870389cc2]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== disconnect_volume: return (365ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:16:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:16:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Deleting instance files /opt/stack/data/nova/instances/d45e0bb0-526c-4940-a196-b21ff0589987_del
Nov 16 18:16:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Deletion of /opt/stack/data/nova/instances/d45e0bb0-526c-4940-a196-b21ff0589987_del complete
Nov 16 18:16:40 user nova-compute[75342]: INFO nova.compute.manager [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 16 18:16:40 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:16:40 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:16:40 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:16:40 user nova-compute[75342]: DEBUG nova.compute.manager [req-b547c16a-5c15-4089-bacf-d7bcff101856 req-341d1fcd-2672-4405-b723-2cc74e181543 service nova] [instance: 361ee32d-4ad3-4bd3-bdf9-6fd404d0f297] Received event network-vif-deleted-326f6a9c-1559-4846-b2df-cb6b8ac9eed9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:16:40 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:16:40 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Took 0.65 seconds to deallocate network for instance.
Nov 16 18:16:40 user nova-compute[75342]: DEBUG nova.compute.manager [req-4e43bfec-586a-4ca4-b055-c8b199a85ce2 req-52fe8546-53d0-4499-8c95-e600fd892c81 service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Received event network-vif-plugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:16:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4e43bfec-586a-4ca4-b055-c8b199a85ce2 req-52fe8546-53d0-4499-8c95-e600fd892c81 service nova] Acquiring lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4e43bfec-586a-4ca4-b055-c8b199a85ce2 req-52fe8546-53d0-4499-8c95-e600fd892c81 service nova] Lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4e43bfec-586a-4ca4-b055-c8b199a85ce2 req-52fe8546-53d0-4499-8c95-e600fd892c81 service nova] Lock "d45e0bb0-526c-4940-a196-b21ff0589987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:40 user nova-compute[75342]: DEBUG nova.compute.manager [req-4e43bfec-586a-4ca4-b055-c8b199a85ce2 req-52fe8546-53d0-4499-8c95-e600fd892c81 service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] No waiting events found dispatching network-vif-plugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:16:40 user nova-compute[75342]: WARNING nova.compute.manager [req-4e43bfec-586a-4ca4-b055-c8b199a85ce2 req-52fe8546-53d0-4499-8c95-e600fd892c81 service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Received unexpected event network-vif-plugged-f581155c-2be9-4fa2-8e60-2fd067dfb38d for instance with vm_state active and task_state deleting.
Nov 16 18:16:41 user nova-compute[75342]: INFO nova.compute.manager [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Took 0.76 seconds to detach 1 volumes for instance.
Nov 16 18:16:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:41 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:16:41 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:16:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:41 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Deleted allocations for instance d45e0bb0-526c-4940-a196-b21ff0589987
Nov 16 18:16:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef3ec74b-6306-42bc-a985-57ea476d1606 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "d45e0bb0-526c-4940-a196-b21ff0589987" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.349s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-28852118-c4ce-46a1-a95e-7bbe40f0c630 req-c72be860-a19e-4f36-9e38-958527d182f1 service nova] [instance: d45e0bb0-526c-4940-a196-b21ff0589987] Received event network-vif-deleted-f581155c-2be9-4fa2-8e60-2fd067dfb38d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:16:43 user nova-compute[75342]: INFO nova.compute.manager [None req-51dd942b-0735-4043-8ff3-0973fd9ec87a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Get console output
Nov 16 18:16:43 user nova-compute[75342]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 16 18:16:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:16:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:16:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:16:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:45 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:16:46 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:16:47 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c53c3ddf-a478-4692-81b0-1b3e403f0cea is timed out.
Nov 16 18:16:47 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Successfully detached device vdc from instance c53c3ddf-a478-4692-81b0-1b3e403f0cea from the live domain config.
Nov 16 18:16:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWfMYnoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:16:47 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d101f4-b121-4abd-86ee-39ad1b681f77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:16:47 user nova-compute[75342]: No targets found.
Nov 16 18:16:47 user nova-compute[75342]: iSNS:
Nov 16 18:16:47 user nova-compute[75342]: No targets found.
Nov 16 18:16:47 user nova-compute[75342]: STATIC:
Nov 16 18:16:47 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:16:47 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:47 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:47 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8
Nov 16 18:16:47 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:47 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:47 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:16:47 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:47 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:47 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717
Nov 16 18:16:47 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:47 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:47 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b
Nov 16 18:16:47 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:47 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:47 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6
Nov 16 18:16:47 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:47 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:47 user nova-compute[75342]: FIRMWARE:
Nov 16 18:16:47 user nova-compute[75342]: No targets found.
Nov 16 18:16:47 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:16:47 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:16:47 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a86f97-8467-404e-bd82-fb0ade89727c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71fc42f-e2a5-4b5c-9119-7b6fd3f72b9a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:47 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:47 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:47 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:47 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:47 user nova-compute[75342]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 (non-flash)
Nov 16 18:16:47 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:47 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:47 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:47 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:47 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:47 user nova-compute[75342]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 (non-flash)
Nov 16 18:16:47 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a458fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6'): ({'sdg'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Removing single pathed devices sdg {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b938064-48de-4a52-acf7-f32e9a819219]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1f0f9f-1820-4aa2-a9fe-e2b51c232645]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Flushing IO for device /dev/sdg {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c59c5e1-a975-4a09-9914-0b3faf9ca664]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[41969a32-5b07-45cd-8599-654ea9bc52d7]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] SCSI volumes sdg have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a43ddc-a331-47f8-9d47-34ee699a3594]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f0380-14b1-4678-aedb-bcbefd34c7a0]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6, portal: 172.16.0.220,3260]
Nov 16 18:16:47 user nova-compute[75342]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6, portal: 172.16.0.220,3260] successful.
Nov 16 18:16:47 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ec4577-fc24-46c0-a9e9-22dd6bf74ed6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe770dc-7c01-4d32-80b5-7e2b5fa0c30a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] <== disconnect_volume: return (321ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:16:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lazy-loading 'flavor' on Instance uuid c53c3ddf-a478-4692-81b0-1b3e403f0cea {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f3640cf0-688e-4908-90f3-9532aedcca43 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.850s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:16:48 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:50 user nova-compute[75342]: INFO nova.compute.manager [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Terminating instance
Nov 16 18:16:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-afda54ae-c13c-49c6-9240-e892b90fa48f req-6402a413-5501-44c8-80dd-39bedc82dc09 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-unplugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-afda54ae-c13c-49c6-9240-e892b90fa48f req-6402a413-5501-44c8-80dd-39bedc82dc09 service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-afda54ae-c13c-49c6-9240-e892b90fa48f req-6402a413-5501-44c8-80dd-39bedc82dc09 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-afda54ae-c13c-49c6-9240-e892b90fa48f req-6402a413-5501-44c8-80dd-39bedc82dc09 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-afda54ae-c13c-49c6-9240-e892b90fa48f req-6402a413-5501-44c8-80dd-39bedc82dc09 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-unplugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-afda54ae-c13c-49c6-9240-e892b90fa48f req-6402a413-5501-44c8-80dd-39bedc82dc09 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-unplugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Instance destroyed successfully.
Nov 16 18:16:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'resources' on Instance uuid c82d7adf-64ed-4573-9b2f-58c1daab2651 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1447790317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1447790317',id=32,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-ulwm4ntp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:15:05Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=c82d7adf-64ed-4573-9b2f-58c1daab2651,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "6867e53c-2663-4167-9934-1fccd82b160e", "address": "fa:16:3e:5f:37:dd", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6867e53c-26", "ovs_interfaceid": "6867e53c-2663-4167-9934-1fccd82b160e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:37:dd,bridge_name='br-int',has_traffic_filtering=True,id=6867e53c-2663-4167-9934-1fccd82b160e,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6867e53c-26') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_vif [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:37:dd,bridge_name='br-int',has_traffic_filtering=True,id=6867e53c-2663-4167-9934-1fccd82b160e,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6867e53c-26') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6867e53c-26, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdb549fb-9e40-4057-a8a6-705ec030e060) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:16:51 user nova-compute[75342]: INFO os_vif [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:37:dd,bridge_name='br-int',has_traffic_filtering=True,id=6867e53c-2663-4167-9934-1fccd82b160e,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6867e53c-26')
Nov 16 18:16:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCMdjWuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:16:51 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dece3bb-ae72-40f5-baa8-7cb1df053f78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:16:51 user nova-compute[75342]: No targets found.
Nov 16 18:16:51 user nova-compute[75342]: iSNS:
Nov 16 18:16:51 user nova-compute[75342]: No targets found.
Nov 16 18:16:51 user nova-compute[75342]: STATIC:
Nov 16 18:16:51 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:16:51 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:51 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:51 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8
Nov 16 18:16:51 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:51 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:51 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:16:51 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:51 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:51 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717
Nov 16 18:16:51 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:51 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:51 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b
Nov 16 18:16:51 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:16:51 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:16:51 user nova-compute[75342]: FIRMWARE:
Nov 16 18:16:51 user nova-compute[75342]: No targets found.
Nov 16 18:16:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:16:51 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:16:51 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea8c5af-0cef-4228-9550-daa5eefffeea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d2085-8510-4a9a-9cfa-0d528dc794fc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:51 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:51 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:51 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:51 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:16:51 user nova-compute[75342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b (non-flash)
Nov 16 18:16:51 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:16:51 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:16:51 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:16:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a458dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b'): ({'sdh'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Removing single pathed devices sdh {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[770ca830-59e0-46e2-97b8-6a5b7465ba9f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee2c751-61a4-40a2-a552-10d3553a9dfb]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flushing IO for device /dev/sdh {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51c6f74-b17c-4767-b0a4-2ea19417e65e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e523343f-fca6-4df9-a398-ee2f0011530d]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] SCSI volumes sdh have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a6f4f0a2', '/dev/disk/by-id/scsi-1SCST_BIOa6f4f0a2-525bc3bc1166ae09', '/dev/disk/by-id/scsi-23532356263336263') {{(pid=85570) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac32a84-844c-42d4-92ad-ed4fc42d5980]: (4, None) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb1da4e-e1ed-4762-bfbe-ea83353baf98]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1034c5f-2398-41b0-b9c3-ed65e82b9f4b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b, portal: 172.16.0.220,3260]
Nov 16 18:16:51 user nova-compute[75342]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b, portal: 172.16.0.220,3260] successful.
Nov 16 18:16:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:335277d4-b4fa-4f08-a27e-20f9fc786c5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a3b859-2f56-4a84-a178-cdc703fb78e1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] <== disconnect_volume: return (394ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:16:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Deleting instance files /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651_del
Nov 16 18:16:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Deletion of /opt/stack/data/nova/instances/c82d7adf-64ed-4573-9b2f-58c1daab2651_del complete
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:16:51 user nova-compute[75342]: INFO nova.compute.manager [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 16 18:16:51 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:16:51 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:16:52 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:16:52 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7649MB free_disk=24.991439819335938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 120e116f-a0e5-406c-9883-6f173da89100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c82d7adf-64ed-4573-9b2f-58c1daab2651 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c53c3ddf-a478-4692-81b0-1b3e403f0cea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 06eb90ec-da8e-46c1-9401-b9613ebe92c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:16:52 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Took 0.85 seconds to deallocate network for instance.
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-f6c410c3-c0b4-43bc-9412-8e57d5250477 req-0333dcee-98bf-42bc-81f9-4734d8e0be07 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f6c410c3-c0b4-43bc-9412-8e57d5250477 req-0333dcee-98bf-42bc-81f9-4734d8e0be07 service nova] Acquiring lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f6c410c3-c0b4-43bc-9412-8e57d5250477 req-0333dcee-98bf-42bc-81f9-4734d8e0be07 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f6c410c3-c0b4-43bc-9412-8e57d5250477 req-0333dcee-98bf-42bc-81f9-4734d8e0be07 service nova] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-f6c410c3-c0b4-43bc-9412-8e57d5250477 req-0333dcee-98bf-42bc-81f9-4734d8e0be07 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] No waiting events found dispatching network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:16:52 user nova-compute[75342]: WARNING nova.compute.manager [req-f6c410c3-c0b4-43bc-9412-8e57d5250477 req-0333dcee-98bf-42bc-81f9-4734d8e0be07 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received unexpected event network-vif-plugged-6867e53c-2663-4167-9934-1fccd82b160e for instance with vm_state active and task_state deleting.
Nov 16 18:16:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-f6c410c3-c0b4-43bc-9412-8e57d5250477 req-0333dcee-98bf-42bc-81f9-4734d8e0be07 service nova] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Received event network-vif-deleted-6867e53c-2663-4167-9934-1fccd82b160e {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:16:53 user nova-compute[75342]: INFO nova.compute.manager [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: c82d7adf-64ed-4573-9b2f-58c1daab2651] Took 0.73 seconds to detach 1 volumes for instance.
Nov 16 18:16:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:16:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:16:53 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:16:53 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:16:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:53 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Deleted allocations for instance c82d7adf-64ed-4573-9b2f-58c1daab2651
Nov 16 18:16:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ac57d9c0-a550-47da-84bf-ba9c557009e5 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "c82d7adf-64ed-4573-9b2f-58c1daab2651" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.391s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:16:54 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:16:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:16:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:16:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:16:54 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:16:55 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Updating instance_info_cache with network_info: [{"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:16:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-d0385123-12ff-41a3-a78d-ac5ce325ae0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:16:55 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:16:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:16:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:16:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:17:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:04 user nova-compute[75342]: INFO nova.compute.manager [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Terminating instance
Nov 16 18:17:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:17:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Instance destroyed successfully.
Nov 16 18:17:05 user nova-compute[75342]: DEBUG nova.objects.instance [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lazy-loading 'resources' on Instance uuid 06eb90ec-da8e-46c1-9401-b9613ebe92c0 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T18:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1820588361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1820588361',id=33,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP5DtxWdGwxM/d1hsyt2mQTYeKWcOFtoSPQ5b4E2L6TQIIA18JIlNqXNV7CVub0oAkDX93T4/krIINufmG3TeA/Jah0HxbBoOZgsCK8a8QOI2ExAuLhoZN2jkOUV6V43w==',key_name='tempest-keypair-1106578881',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:15:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b314838880c4cf68c74b2a215fa0a78',ramdisk_id='',reservation_id='r-wuca4hmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1298817282',owner_user_name='tempest-AttachVolumeShelveTestJSON-1298817282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:15:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5976cde7fade404fac5146e3952cc95f',uuid=06eb90ec-da8e-46c1-9401-b9613ebe92c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converting VIF {"id": "a81da486-f0aa-446c-8682-d37aea664738", "address": "fa:16:3e:cf:0b:65", "network": {"id": "61b8c501-c808-4301-877f-278d4b9c8c25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-646444784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b314838880c4cf68c74b2a215fa0a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81da486-f0", "ovs_interfaceid": "a81da486-f0aa-446c-8682-d37aea664738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG os_vif [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa81da486-f0, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=658146e9-7b12-48e0-9b3e-c7de1f56533f) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:05 user nova-compute[75342]: INFO os_vif [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:0b:65,bridge_name='br-int',has_traffic_filtering=True,id=a81da486-f0aa-446c-8682-d37aea664738,network=Network(61b8c501-c808-4301-877f-278d4b9c8c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81da486-f0')
Nov 16 18:17:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Deleting instance files /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0_del
Nov 16 18:17:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Deletion of /opt/stack/data/nova/instances/06eb90ec-da8e-46c1-9401-b9613ebe92c0_del complete
Nov 16 18:17:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-baae9c33-84a1-4423-a72a-2b4bf7a64972 req-30ad84be-6602-4b62-a112-d5ca03261b76 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-vif-unplugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-baae9c33-84a1-4423-a72a-2b4bf7a64972 req-30ad84be-6602-4b62-a112-d5ca03261b76 service nova] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-baae9c33-84a1-4423-a72a-2b4bf7a64972 req-30ad84be-6602-4b62-a112-d5ca03261b76 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-baae9c33-84a1-4423-a72a-2b4bf7a64972 req-30ad84be-6602-4b62-a112-d5ca03261b76 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-baae9c33-84a1-4423-a72a-2b4bf7a64972 req-30ad84be-6602-4b62-a112-d5ca03261b76 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] No waiting events found dispatching network-vif-unplugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-baae9c33-84a1-4423-a72a-2b4bf7a64972 req-30ad84be-6602-4b62-a112-d5ca03261b76 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-vif-unplugged-a81da486-f0aa-446c-8682-d37aea664738 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:17:05 user nova-compute[75342]: INFO nova.compute.manager [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 16 18:17:05 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:17:05 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:17:06 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:17:06 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Took 0.81 seconds to deallocate network for instance.
Nov 16 18:17:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:06 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:17:06 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:17:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:06 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Deleted allocations for instance 06eb90ec-da8e-46c1-9401-b9613ebe92c0
Nov 16 18:17:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-10e3c6b5-963b-42af-80e5-f2aad33fcaad tempest-AttachVolumeShelveTestJSON-1298817282 tempest-AttachVolumeShelveTestJSON-1298817282-project-member] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.988s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-0c472883-37e1-4d3d-9881-b9767ba64886 req-3fd9b1cf-0ef8-4c7c-afae-fc4edcd81868 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0c472883-37e1-4d3d-9881-b9767ba64886 req-3fd9b1cf-0ef8-4c7c-afae-fc4edcd81868 service nova] Acquiring lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0c472883-37e1-4d3d-9881-b9767ba64886 req-3fd9b1cf-0ef8-4c7c-afae-fc4edcd81868 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0c472883-37e1-4d3d-9881-b9767ba64886 req-3fd9b1cf-0ef8-4c7c-afae-fc4edcd81868 service nova] Lock "06eb90ec-da8e-46c1-9401-b9613ebe92c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-0c472883-37e1-4d3d-9881-b9767ba64886 req-3fd9b1cf-0ef8-4c7c-afae-fc4edcd81868 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] No waiting events found dispatching network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:17:07 user nova-compute[75342]: WARNING nova.compute.manager [req-0c472883-37e1-4d3d-9881-b9767ba64886 req-3fd9b1cf-0ef8-4c7c-afae-fc4edcd81868 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received unexpected event network-vif-plugged-a81da486-f0aa-446c-8682-d37aea664738 for instance with vm_state deleted and task_state None.
Nov 16 18:17:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-0c472883-37e1-4d3d-9881-b9767ba64886 req-3fd9b1cf-0ef8-4c7c-afae-fc4edcd81868 service nova] [instance: 06eb90ec-da8e-46c1-9401-b9613ebe92c0] Received event network-vif-deleted-a81da486-f0aa-446c-8682-d37aea664738 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:17:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-5679e935-4f56-4edd-9baa-b34adc296fbb req-ccea12b2-5790-4f5b-a3ec-fa6e06ef086e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-changed-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-5679e935-4f56-4edd-9baa-b34adc296fbb req-ccea12b2-5790-4f5b-a3ec-fa6e06ef086e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Refreshing instance network info cache due to event network-changed-01f59d58-7783-45da-bc6c-5834a6924118. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:17:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5679e935-4f56-4edd-9baa-b34adc296fbb req-ccea12b2-5790-4f5b-a3ec-fa6e06ef086e service nova] Acquiring lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:17:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5679e935-4f56-4edd-9baa-b34adc296fbb req-ccea12b2-5790-4f5b-a3ec-fa6e06ef086e service nova] Acquired lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:17:15 user nova-compute[75342]: DEBUG nova.network.neutron [req-5679e935-4f56-4edd-9baa-b34adc296fbb req-ccea12b2-5790-4f5b-a3ec-fa6e06ef086e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Refreshing network info cache for port 01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:17:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:16 user nova-compute[75342]: INFO nova.compute.manager [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Detaching volume 524806f7-7999-4344-afe4-1d35485bebc8
Nov 16 18:17:16 user nova-compute[75342]: DEBUG nova.network.neutron [req-5679e935-4f56-4edd-9baa-b34adc296fbb req-ccea12b2-5790-4f5b-a3ec-fa6e06ef086e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updated VIF entry in instance network info cache for port 01f59d58-7783-45da-bc6c-5834a6924118. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:17:16 user nova-compute[75342]: DEBUG nova.network.neutron [req-5679e935-4f56-4edd-9baa-b34adc296fbb req-ccea12b2-5790-4f5b-a3ec-fa6e06ef086e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updating instance_info_cache with network_info: [{"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:17:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5679e935-4f56-4edd-9baa-b34adc296fbb req-ccea12b2-5790-4f5b-a3ec-fa6e06ef086e service nova] Releasing lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:17:16 user nova-compute[75342]: INFO nova.virt.block_device [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Attempting to driver detach volume 524806f7-7999-4344-afe4-1d35485bebc8 from mountpoint /dev/vdb
Nov 16 18:17:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Attempting to detach device vdb from instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:17:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:17:16 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:17:16 user nova-compute[75342]:   <source dev="/dev/sde"/>
Nov 16 18:17:16 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:17:16 user nova-compute[75342]:   <serial>524806f7-7999-4344-afe4-1d35485bebc8</serial>
Nov 16 18:17:16 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:17:16 user nova-compute[75342]: </disk>
Nov 16 18:17:16 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:17:16 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Successfully detached device vdb from instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c from the persistent domain config.
Nov 16 18:17:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:17:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:17:16 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:17:16 user nova-compute[75342]:   <source dev="/dev/sde"/>
Nov 16 18:17:16 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:17:16 user nova-compute[75342]:   <serial>524806f7-7999-4344-afe4-1d35485bebc8</serial>
Nov 16 18:17:16 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:17:16 user nova-compute[75342]: </disk>
Nov 16 18:17:16 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:17:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:17:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:17 user nova-compute[75342]: INFO nova.compute.manager [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Detaching volume 8a3e0109-5138-44cc-9cd3-ee26efa7d717
Nov 16 18:17:17 user nova-compute[75342]: INFO nova.virt.block_device [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Attempting to driver detach volume 8a3e0109-5138-44cc-9cd3-ee26efa7d717 from mountpoint /dev/vdb
Nov 16 18:17:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Attempting to detach device vdb from instance c53c3ddf-a478-4692-81b0-1b3e403f0cea from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:17:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:17:17 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:17:17 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:17:17 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:17:17 user nova-compute[75342]:   <serial>8a3e0109-5138-44cc-9cd3-ee26efa7d717</serial>
Nov 16 18:17:17 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:17:17 user nova-compute[75342]: </disk>
Nov 16 18:17:17 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:17:17 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Successfully detached device vdb from instance c53c3ddf-a478-4692-81b0-1b3e403f0cea from the persistent domain config.
Nov 16 18:17:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c53c3ddf-a478-4692-81b0-1b3e403f0cea from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:17:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:17:17 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:17:17 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:17:17 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:17:17 user nova-compute[75342]:   <serial>8a3e0109-5138-44cc-9cd3-ee26efa7d717</serial>
Nov 16 18:17:17 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:17:17 user nova-compute[75342]: </disk>
Nov 16 18:17:17 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:17:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-4d69afff-8f4f-4d6b-9cb2-65fa5260c477 req-17fe514e-d411-41a0-860f-b35380672292 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-changed-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-4d69afff-8f4f-4d6b-9cb2-65fa5260c477 req-17fe514e-d411-41a0-860f-b35380672292 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Refreshing instance network info cache due to event network-changed-01f59d58-7783-45da-bc6c-5834a6924118. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:17:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4d69afff-8f4f-4d6b-9cb2-65fa5260c477 req-17fe514e-d411-41a0-860f-b35380672292 service nova] Acquiring lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:17:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4d69afff-8f4f-4d6b-9cb2-65fa5260c477 req-17fe514e-d411-41a0-860f-b35380672292 service nova] Acquired lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:17:17 user nova-compute[75342]: DEBUG nova.network.neutron [req-4d69afff-8f4f-4d6b-9cb2-65fa5260c477 req-17fe514e-d411-41a0-860f-b35380672292 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Refreshing network info cache for port 01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:17:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c53c3ddf-a478-4692-81b0-1b3e403f0cea {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:17:18 user nova-compute[75342]: DEBUG nova.network.neutron [req-4d69afff-8f4f-4d6b-9cb2-65fa5260c477 req-17fe514e-d411-41a0-860f-b35380672292 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updated VIF entry in instance network info cache for port 01f59d58-7783-45da-bc6c-5834a6924118. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:17:18 user nova-compute[75342]: DEBUG nova.network.neutron [req-4d69afff-8f4f-4d6b-9cb2-65fa5260c477 req-17fe514e-d411-41a0-860f-b35380672292 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updating instance_info_cache with network_info: [{"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:17:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4d69afff-8f4f-4d6b-9cb2-65fa5260c477 req-17fe514e-d411-41a0-860f-b35380672292 service nova] Releasing lock "refresh_cache-9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:17:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:17:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "bd8e6fae-5355-449f-a552-e90f74d189d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:30 user nova-compute[75342]: DEBUG nova.compute.manager [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:17:30 user nova-compute[75342]: DEBUG nova.compute.manager [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:17:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:30 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:17:30 user nova-compute[75342]: INFO nova.compute.claims [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Claim successful on node user
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.428s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:17:31 user nova-compute[75342]: INFO nova.compute.claims [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Claim successful on node user
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.network.neutron [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:17:31 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.policy [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1da0d585d0e04be284e3eb50ce093d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b7dafce5e534279b01a17644c620e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:17:31 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Creating image(s)
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "/opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "/opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "/opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG nova.network.neutron [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk 1073741824" returned: 0 in 0.061s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:32 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.compute.manager [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.policy [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '062cd6d338014493be6c40701d2a735b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d44dce2b444ef386b47927d5c70c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.network.neutron [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Successfully created port: 8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:17:32 user nova-compute[75342]: INFO nova.virt.block_device [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Booting with volume f1b7789f-96b0-4cc3-9042-ad3199d965da at /dev/vda
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.208s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG os_brick.utils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bd6b3e-d8d5-4548-9f18-989a616ba172]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e641ce9-19ee-4f01-9836-963602a27d2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[449a025d-7135-4243-89c8-3e5327eaaf21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cef4253-ed7e-4928-8425-cdfb93fb65a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:17:32 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedb2929-6b52-43f2-b249-79937fb13910]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG os_brick.utils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Updating existing volume attachment record: 5cdf3425-345d-4c29-9351-23eed64c842e {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Cannot resize image /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Ensure instance console log exists: /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.network.neutron [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Successfully updated port: 8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquired lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.network.neutron [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-cfe5d1e6-90a8-4f57-9def-490af40ca7b7 req-8bd32d0e-6785-4fa6-8164-cea6102f75c4 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Received event network-changed-8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-cfe5d1e6-90a8-4f57-9def-490af40ca7b7 req-8bd32d0e-6785-4fa6-8164-cea6102f75c4 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Refreshing instance network info cache due to event network-changed-8603ce17-5b31-4dda-8c75-8ff1e75675fc. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:17:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cfe5d1e6-90a8-4f57-9def-490af40ca7b7 req-8bd32d0e-6785-4fa6-8164-cea6102f75c4 service nova] Acquiring lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.neutron [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.neutron [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Successfully created port: 60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.neutron [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Updating instance_info_cache with network_info: [{"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Releasing lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.compute.manager [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Instance network_info: |[{"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cfe5d1e6-90a8-4f57-9def-490af40ca7b7 req-8bd32d0e-6785-4fa6-8164-cea6102f75c4 service nova] Acquired lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.neutron [req-cfe5d1e6-90a8-4f57-9def-490af40ca7b7 req-8bd32d0e-6785-4fa6-8164-cea6102f75c4 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Refreshing network info cache for port 8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Start _get_guest_xml network_info=[{"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:17:33 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:17:33 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-231509914',display_name='tempest-AttachVolumeTestJSON-server-231509914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-231509914',id=37,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEklYip5of/khCdwX2XmwZLShcRmqFBI9rG/qEROhbyuGDtEGXOFi9VRQtFk10uUhfSiSilOVJSbAk02/dhyLCrrOtrM9RjWFkwQ7Nn80PO6YawNXKgoLEmfxpbQ0GiIIA==',key_name='tempest-keypair-725961595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-82i8w713',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=01d59cab-ff4e-4c62-92cc-50eca7089f6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a5:e7,bridge_name='br-int',has_traffic_filtering=True,id=8603ce17-5b31-4dda-8c75-8ff1e75675fc,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8603ce17-5b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.objects.instance [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'pci_devices' on Instance uuid 01d59cab-ff4e-4c62-92cc-50eca7089f6f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:17:33 user nova-compute[75342]:   <uuid>01d59cab-ff4e-4c62-92cc-50eca7089f6f</uuid>
Nov 16 18:17:33 user nova-compute[75342]:   <name>instance-00000025</name>
Nov 16 18:17:33 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:17:33 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:17:33 user nova-compute[75342]:   <metadata>
Nov 16 18:17:33 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:17:33 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:17:33 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeTestJSON-server-231509914</nova:name>
Nov 16 18:17:33 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:17:33</nova:creationTime>
Nov 16 18:17:33 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:17:33 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:17:33 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:17:33 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:17:33 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:17:33 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:17:33 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:17:33 user nova-compute[75342]:       <nova:owner>
Nov 16 18:17:33 user nova-compute[75342]:         <nova:user uuid="1da0d585d0e04be284e3eb50ce093d89">tempest-AttachVolumeTestJSON-410390487-project-member</nova:user>
Nov 16 18:17:33 user nova-compute[75342]:         <nova:project uuid="6b7dafce5e534279b01a17644c620e36">tempest-AttachVolumeTestJSON-410390487</nova:project>
Nov 16 18:17:33 user nova-compute[75342]:       </nova:owner>
Nov 16 18:17:33 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:17:33 user nova-compute[75342]:       <nova:ports>
Nov 16 18:17:33 user nova-compute[75342]:         <nova:port uuid="8603ce17-5b31-4dda-8c75-8ff1e75675fc">
Nov 16 18:17:33 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 18:17:33 user nova-compute[75342]:         </nova:port>
Nov 16 18:17:33 user nova-compute[75342]:       </nova:ports>
Nov 16 18:17:33 user nova-compute[75342]:     </nova:instance>
Nov 16 18:17:33 user nova-compute[75342]:   </metadata>
Nov 16 18:17:33 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:17:33 user nova-compute[75342]:     <system>
Nov 16 18:17:33 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:17:33 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:17:33 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:17:33 user nova-compute[75342]:       <entry name="serial">01d59cab-ff4e-4c62-92cc-50eca7089f6f</entry>
Nov 16 18:17:33 user nova-compute[75342]:       <entry name="uuid">01d59cab-ff4e-4c62-92cc-50eca7089f6f</entry>
Nov 16 18:17:33 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:17:33 user nova-compute[75342]:     </system>
Nov 16 18:17:33 user nova-compute[75342]:   </sysinfo>
Nov 16 18:17:33 user nova-compute[75342]:   <os>
Nov 16 18:17:33 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:17:33 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:17:33 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:17:33 user nova-compute[75342]:   </os>
Nov 16 18:17:33 user nova-compute[75342]:   <features>
Nov 16 18:17:33 user nova-compute[75342]:     <acpi/>
Nov 16 18:17:33 user nova-compute[75342]:     <apic/>
Nov 16 18:17:33 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:17:33 user nova-compute[75342]:   </features>
Nov 16 18:17:33 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:17:33 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:17:33 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:17:33 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:17:33 user nova-compute[75342]:   </clock>
Nov 16 18:17:33 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:17:33 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:17:33 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:17:33 user nova-compute[75342]:   </cpu>
Nov 16 18:17:33 user nova-compute[75342]:   <devices>
Nov 16 18:17:33 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:17:33 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:17:33 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk"/>
Nov 16 18:17:33 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:17:33 user nova-compute[75342]:     </disk>
Nov 16 18:17:33 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:17:33 user nova-compute[75342]:       <mac address="fa:16:3e:d6:a5:e7"/>
Nov 16 18:17:33 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:17:33 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:17:33 user nova-compute[75342]:       <target dev="tap8603ce17-5b"/>
Nov 16 18:17:33 user nova-compute[75342]:     </interface>
Nov 16 18:17:33 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:17:33 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/console.log" append="off"/>
Nov 16 18:17:33 user nova-compute[75342]:     </serial>
Nov 16 18:17:33 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:17:33 user nova-compute[75342]:     <video>
Nov 16 18:17:33 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:17:33 user nova-compute[75342]:     </video>
Nov 16 18:17:33 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:17:33 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:17:33 user nova-compute[75342]:     </rng>
Nov 16 18:17:33 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:17:33 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:17:33 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:17:33 user nova-compute[75342]:     </memballoon>
Nov 16 18:17:33 user nova-compute[75342]:   </devices>
Nov 16 18:17:33 user nova-compute[75342]: </domain>
Nov 16 18:17:33 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-231509914',display_name='tempest-AttachVolumeTestJSON-server-231509914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-231509914',id=37,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEklYip5of/khCdwX2XmwZLShcRmqFBI9rG/qEROhbyuGDtEGXOFi9VRQtFk10uUhfSiSilOVJSbAk02/dhyLCrrOtrM9RjWFkwQ7Nn80PO6YawNXKgoLEmfxpbQ0GiIIA==',key_name='tempest-keypair-725961595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-82i8w713',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=01d59cab-ff4e-4c62-92cc-50eca7089f6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a5:e7,bridge_name='br-int',has_traffic_filtering=True,id=8603ce17-5b31-4dda-8c75-8ff1e75675fc,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8603ce17-5b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG os_vif [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a5:e7,bridge_name='br-int',has_traffic_filtering=True,id=8603ce17-5b31-4dda-8c75-8ff1e75675fc,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8603ce17-5b') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e2aacb9-1d0d-5660-8349-f47e67617c7f', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8603ce17-5b, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8603ce17-5b, col_values=(('qos', UUID('42785676-815a-47f8-9942-6c82b3a3051f')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8603ce17-5b, col_values=(('external_ids', {'iface-id': '8603ce17-5b31-4dda-8c75-8ff1e75675fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:a5:e7', 'vm-uuid': '01d59cab-ff4e-4c62-92cc-50eca7089f6f'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:33 user nova-compute[75342]: INFO os_vif [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a5:e7,bridge_name='br-int',has_traffic_filtering=True,id=8603ce17-5b31-4dda-8c75-8ff1e75675fc,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8603ce17-5b')
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No VIF found with MAC fa:16:3e:d6:a5:e7, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.neutron [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Successfully updated port: 60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquired lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.neutron [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.neutron [req-cfe5d1e6-90a8-4f57-9def-490af40ca7b7 req-8bd32d0e-6785-4fa6-8164-cea6102f75c4 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Updated VIF entry in instance network info cache for port 8603ce17-5b31-4dda-8c75-8ff1e75675fc. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.network.neutron [req-cfe5d1e6-90a8-4f57-9def-490af40ca7b7 req-8bd32d0e-6785-4fa6-8164-cea6102f75c4 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Updating instance_info_cache with network_info: [{"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-29361d54-c125-46d5-a6af-32b17344e0c6 req-2aadf8c8-885b-4596-998c-623772b5b644 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received event network-changed-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-29361d54-c125-46d5-a6af-32b17344e0c6 req-2aadf8c8-885b-4596-998c-623772b5b644 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Refreshing instance network info cache due to event network-changed-60e68362-04fe-4c9a-8c48-2d065c5b6fea. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-29361d54-c125-46d5-a6af-32b17344e0c6 req-2aadf8c8-885b-4596-998c-623772b5b644 service nova] Acquiring lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:17:33 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cfe5d1e6-90a8-4f57-9def-490af40ca7b7 req-8bd32d0e-6785-4fa6-8164-cea6102f75c4 service nova] Releasing lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:17:34 user nova-compute[75342]: DEBUG nova.network.neutron [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:17:34 user nova-compute[75342]: DEBUG nova.network.neutron [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Updating instance_info_cache with network_info: [{"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:17:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Releasing lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:17:34 user nova-compute[75342]: DEBUG nova.compute.manager [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Instance network_info: |[{"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:17:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-29361d54-c125-46d5-a6af-32b17344e0c6 req-2aadf8c8-885b-4596-998c-623772b5b644 service nova] Acquired lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:17:34 user nova-compute[75342]: DEBUG nova.network.neutron [req-29361d54-c125-46d5-a6af-32b17344e0c6 req-2aadf8c8-885b-4596-998c-623772b5b644 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Refreshing network info cache for port 60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:17:34 user nova-compute[75342]: DEBUG nova.network.neutron [req-29361d54-c125-46d5-a6af-32b17344e0c6 req-2aadf8c8-885b-4596-998c-623772b5b644 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Updated VIF entry in instance network info cache for port 60e68362-04fe-4c9a-8c48-2d065c5b6fea. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:17:34 user nova-compute[75342]: DEBUG nova.network.neutron [req-29361d54-c125-46d5-a6af-32b17344e0c6 req-2aadf8c8-885b-4596-998c-623772b5b644 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Updating instance_info_cache with network_info: [{"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:17:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-29361d54-c125-46d5-a6af-32b17344e0c6 req-2aadf8c8-885b-4596-998c-623772b5b644 service nova] Releasing lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:17:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-0e9cbf28-f002-48a8-ba78-90dead01d420 req-bc5596ce-a609-4ef5-baad-a8d3039c1433 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Received event network-vif-plugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0e9cbf28-f002-48a8-ba78-90dead01d420 req-bc5596ce-a609-4ef5-baad-a8d3039c1433 service nova] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0e9cbf28-f002-48a8-ba78-90dead01d420 req-bc5596ce-a609-4ef5-baad-a8d3039c1433 service nova] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0e9cbf28-f002-48a8-ba78-90dead01d420 req-bc5596ce-a609-4ef5-baad-a8d3039c1433 service nova] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-0e9cbf28-f002-48a8-ba78-90dead01d420 req-bc5596ce-a609-4ef5-baad-a8d3039c1433 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] No waiting events found dispatching network-vif-plugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:17:35 user nova-compute[75342]: WARNING nova.compute.manager [req-0e9cbf28-f002-48a8-ba78-90dead01d420 req-bc5596ce-a609-4ef5-baad-a8d3039c1433 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Received unexpected event network-vif-plugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc for instance with vm_state building and task_state spawning.
Nov 16 18:17:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:36 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c is timed out.
Nov 16 18:17:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Successfully detached device vdb from instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c from the live domain config.
Nov 16 18:17:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUASrjJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:17:36 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbfad6d-226e-43e2-8778-48cf88228ea9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:17:36 user nova-compute[75342]: No targets found.
Nov 16 18:17:36 user nova-compute[75342]: iSNS:
Nov 16 18:17:36 user nova-compute[75342]: No targets found.
Nov 16 18:17:36 user nova-compute[75342]: STATIC:
Nov 16 18:17:36 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:17:36 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:17:36 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:17:36 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8
Nov 16 18:17:36 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:17:36 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:17:36 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:17:36 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:17:36 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:17:36 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717
Nov 16 18:17:36 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:17:36 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:17:36 user nova-compute[75342]: FIRMWARE:
Nov 16 18:17:36 user nova-compute[75342]: No targets found.
Nov 16 18:17:36 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:17:36 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:17:36 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0700e9e-b3f2-4ce6-acf5-293d05555a10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91d9195-699f-4ca6-98ba-8d9e06e398e1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:17:36 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:17:36 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:17:36 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:17:36 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:17:36 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:17:36 user nova-compute[75342]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 (non-flash)
Nov 16 18:17:36 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:17:36 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a458dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8'): ({'sde'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Removing single pathed devices sde {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe3be28-7e3c-425f-bacc-8278698045f2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[173547d8-eb2a-453e-b87b-77e5fa3b1612]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Flushing IO for device /dev/sde {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06baaad-3faa-4c3c-a464-5d139f9227db]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a54810-33a2-499e-a7a0-0df406184f20]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[245612f1-6bdb-4599-8d21-53535672a4df]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f18976c-4b34-4b6a-a663-7e440dbc8933]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8, portal: 172.16.0.220,3260]
Nov 16 18:17:37 user nova-compute[75342]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8, portal: 172.16.0.220,3260] successful.
Nov 16 18:17:37 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524806f7-7999-4344-afe4-1d35485bebc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19c4485-b17b-49a4-89bf-07cd48411b30]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] <== disconnect_volume: return (316ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.compute.manager [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:17:37 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Instance spawned successfully.
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-261446f2-eb3c-4d25-84c7-fd7a3d7e5177 req-63cb7e9a-e708-4f64-8d5d-84d73d58a56a service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Received event network-vif-plugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-261446f2-eb3c-4d25-84c7-fd7a3d7e5177 req-63cb7e9a-e708-4f64-8d5d-84d73d58a56a service nova] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-261446f2-eb3c-4d25-84c7-fd7a3d7e5177 req-63cb7e9a-e708-4f64-8d5d-84d73d58a56a service nova] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-261446f2-eb3c-4d25-84c7-fd7a3d7e5177 req-63cb7e9a-e708-4f64-8d5d-84d73d58a56a service nova] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-261446f2-eb3c-4d25-84c7-fd7a3d7e5177 req-63cb7e9a-e708-4f64-8d5d-84d73d58a56a service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] No waiting events found dispatching network-vif-plugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:17:37 user nova-compute[75342]: WARNING nova.compute.manager [req-261446f2-eb3c-4d25-84c7-fd7a3d7e5177 req-63cb7e9a-e708-4f64-8d5d-84d73d58a56a service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Received unexpected event network-vif-plugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc for instance with vm_state building and task_state spawning.
Nov 16 18:17:37 user nova-compute[75342]: INFO nova.compute.manager [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.compute.manager [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:17:37 user nova-compute[75342]: INFO nova.compute.manager [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Took 6.56 seconds to build instance.
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-17fc7fe6-8411-4d64-8d99-210c71fb99bc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.663s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:37 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c53c3ddf-a478-4692-81b0-1b3e403f0cea is timed out.
Nov 16 18:17:37 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Successfully detached device vdb from instance c53c3ddf-a478-4692-81b0-1b3e403f0cea from the live domain config.
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbVDciSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:17:37 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b341563-61de-4012-9418-9957768b95c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:17:37 user nova-compute[75342]: No targets found.
Nov 16 18:17:37 user nova-compute[75342]: iSNS:
Nov 16 18:17:37 user nova-compute[75342]: No targets found.
Nov 16 18:17:37 user nova-compute[75342]: STATIC:
Nov 16 18:17:37 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:17:37 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:17:37 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:17:37 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:17:37 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:17:37 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:17:37 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717
Nov 16 18:17:37 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:17:37 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:17:37 user nova-compute[75342]: FIRMWARE:
Nov 16 18:17:37 user nova-compute[75342]: No targets found.
Nov 16 18:17:37 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:17:37 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:17:37 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG nova.objects.instance [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'flavor' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1248d3c9-fdf3-45ac-a4fd-c26f174fa365]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a849981-0583-4cef-bea4-febe3b9bde8b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:17:37 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:17:37 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:17:37 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:17:37 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:17:37 user nova-compute[75342]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 (non-flash)
Nov 16 18:17:37 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a466d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717'): ({'sdc'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Removing single pathed devices sdc {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cdeb5f6-dc91-479f-94a8-aab798a00ed8 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.805s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be061ff-617c-4aac-b457-0d521d9710a7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8865473a-4eef-436c-8521-b8b18dbd95e3]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Flushing IO for device /dev/sdc {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98ee564-a007-4205-b624-c40ba48922b4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4500722-7c97-4148-9f0a-2c74af9940d5]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d6bf14-3bdd-4cb4-a366-56611537224b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f12f7e3-5118-4049-adbe-9cab6030b590]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717, portal: 172.16.0.220,3260]
Nov 16 18:17:38 user nova-compute[75342]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717, portal: 172.16.0.220,3260] successful.
Nov 16 18:17:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3e0109-5138-44cc-9cd3-ee26efa7d717 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee86c51-7255-42d4-8ee7-05f4078638b1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] <== disconnect_volume: return (329ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.compute.manager [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:17:38 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Creating image(s)
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Ensure instance console log exists: /opt/stack/data/nova/instances/bd8e6fae-5355-449f-a552-e90f74d189d7/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Start _get_guest_xml network_info=[{"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5cdf3425-345d-4c29-9351-23eed64c842e', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAElFIVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd8e6fae-5355-449f-a552-e90f74d189d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1b7789f-96b0-4cc3-9042-ad3199d965da', 'serial': 'f1b7789f-96b0-4cc3-9042-ad3199d965da'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:17:38 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:17:38 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAElFIVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:17:38 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:17:38 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:17:38 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8833c603-4bd7-490b-b74d-9a974b8856b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:17:38 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3517ed34-3ecd-49bc-8645-163ff39513e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da] added
Nov 16 18:17:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45b28a4-cd8f-46e6-989d-813df7b467d7]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5afb2d-20d8-4853-9a6a-3cef81d1f798]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAElFIVC {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SAElFIVC" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[740454b2-07fb-4d1b-b910-ae9d5e916599]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SAElFIVC'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e9eac0-c55a-4945-822d-11a980b1428b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a469bb7-28f0-4202-9eea-06ad1a74a1f8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:17:38 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:17:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:17:38 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:17:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eadbba0-d380-4c6a-abdd-433f415ccf05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260]
Nov 16 18:17:38 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260] successful.
Nov 16 18:17:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a910914b-6a49-4df0-a809-39c556906075]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[139601a4-bfc9-46f6-8337-d9891771be3d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:17:38 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:17:38 user nova-compute[75342]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:17:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:17:38 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:17:38 user nova-compute[75342]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:17:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d0c600-9f76-4440-8956-9ae9e73b5d68]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:17:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAElFIVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lazy-loading 'flavor' on Instance uuid c53c3ddf-a478-4692-81b0-1b3e403f0cea {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ca0f76f3-823f-4434-9108-6bfbb198223c tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.767s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26566343435383662', 'path': '/dev/sdc'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566343435383662', 'path': '/dev/sdc'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1768646067',display_name='tempest-TestVolumeBootPattern-server-1768646067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1768646067',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxsC14B7FXvV2fSoMtlJDAqdPeFWveN/Z0Ifom/f6iLWm22eKeX4OVWWNojR/qqP5b5ZDw4QQNhLxzsgEQuPgfcqpGQNglCOOs11ACZVIFU1+eY4bhyAYc4WrWEkoqGQ==',key_name='tempest-TestVolumeBootPattern-2105905581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-4ayeigdw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:17:32Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=bd8e6fae-5355-449f-a552-e90f74d189d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:30:ef,bridge_name='br-int',has_traffic_filtering=True,id=60e68362-04fe-4c9a-8c48-2d065c5b6fea,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60e68362-04') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'pci_devices' on Instance uuid bd8e6fae-5355-449f-a552-e90f74d189d7 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:17:39 user nova-compute[75342]:   <uuid>bd8e6fae-5355-449f-a552-e90f74d189d7</uuid>
Nov 16 18:17:39 user nova-compute[75342]:   <name>instance-00000026</name>
Nov 16 18:17:39 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:17:39 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:17:39 user nova-compute[75342]:   <metadata>
Nov 16 18:17:39 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:17:39 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:17:39 user nova-compute[75342]:       <nova:name>tempest-TestVolumeBootPattern-server-1768646067</nova:name>
Nov 16 18:17:39 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:17:38</nova:creationTime>
Nov 16 18:17:39 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:17:39 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:17:39 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:17:39 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:17:39 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:17:39 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:17:39 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:17:39 user nova-compute[75342]:       <nova:owner>
Nov 16 18:17:39 user nova-compute[75342]:         <nova:user uuid="062cd6d338014493be6c40701d2a735b">tempest-TestVolumeBootPattern-312873750-project-member</nova:user>
Nov 16 18:17:39 user nova-compute[75342]:         <nova:project uuid="46d44dce2b444ef386b47927d5c70c8e">tempest-TestVolumeBootPattern-312873750</nova:project>
Nov 16 18:17:39 user nova-compute[75342]:       </nova:owner>
Nov 16 18:17:39 user nova-compute[75342]:       <nova:ports>
Nov 16 18:17:39 user nova-compute[75342]:         <nova:port uuid="60e68362-04fe-4c9a-8c48-2d065c5b6fea">
Nov 16 18:17:39 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 18:17:39 user nova-compute[75342]:         </nova:port>
Nov 16 18:17:39 user nova-compute[75342]:       </nova:ports>
Nov 16 18:17:39 user nova-compute[75342]:     </nova:instance>
Nov 16 18:17:39 user nova-compute[75342]:   </metadata>
Nov 16 18:17:39 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:17:39 user nova-compute[75342]:     <system>
Nov 16 18:17:39 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:17:39 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:17:39 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:17:39 user nova-compute[75342]:       <entry name="serial">bd8e6fae-5355-449f-a552-e90f74d189d7</entry>
Nov 16 18:17:39 user nova-compute[75342]:       <entry name="uuid">bd8e6fae-5355-449f-a552-e90f74d189d7</entry>
Nov 16 18:17:39 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:17:39 user nova-compute[75342]:     </system>
Nov 16 18:17:39 user nova-compute[75342]:   </sysinfo>
Nov 16 18:17:39 user nova-compute[75342]:   <os>
Nov 16 18:17:39 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:17:39 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:17:39 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:17:39 user nova-compute[75342]:   </os>
Nov 16 18:17:39 user nova-compute[75342]:   <features>
Nov 16 18:17:39 user nova-compute[75342]:     <acpi/>
Nov 16 18:17:39 user nova-compute[75342]:     <apic/>
Nov 16 18:17:39 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:17:39 user nova-compute[75342]:   </features>
Nov 16 18:17:39 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:17:39 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:17:39 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:17:39 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:17:39 user nova-compute[75342]:   </clock>
Nov 16 18:17:39 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:17:39 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:17:39 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:17:39 user nova-compute[75342]:   </cpu>
Nov 16 18:17:39 user nova-compute[75342]:   <devices>
Nov 16 18:17:39 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:17:39 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:17:39 user nova-compute[75342]:       <source dev="/dev/sdc"/>
Nov 16 18:17:39 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:17:39 user nova-compute[75342]:       <serial>f1b7789f-96b0-4cc3-9042-ad3199d965da</serial>
Nov 16 18:17:39 user nova-compute[75342]:     </disk>
Nov 16 18:17:39 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:17:39 user nova-compute[75342]:       <mac address="fa:16:3e:a9:30:ef"/>
Nov 16 18:17:39 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:17:39 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:17:39 user nova-compute[75342]:       <target dev="tap60e68362-04"/>
Nov 16 18:17:39 user nova-compute[75342]:     </interface>
Nov 16 18:17:39 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:17:39 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/bd8e6fae-5355-449f-a552-e90f74d189d7/console.log" append="off"/>
Nov 16 18:17:39 user nova-compute[75342]:     </serial>
Nov 16 18:17:39 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:17:39 user nova-compute[75342]:     <video>
Nov 16 18:17:39 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:17:39 user nova-compute[75342]:     </video>
Nov 16 18:17:39 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:17:39 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:17:39 user nova-compute[75342]:     </rng>
Nov 16 18:17:39 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:17:39 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:17:39 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:17:39 user nova-compute[75342]:     </memballoon>
Nov 16 18:17:39 user nova-compute[75342]:   </devices>
Nov 16 18:17:39 user nova-compute[75342]: </domain>
Nov 16 18:17:39 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1768646067',display_name='tempest-TestVolumeBootPattern-server-1768646067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1768646067',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxsC14B7FXvV2fSoMtlJDAqdPeFWveN/Z0Ifom/f6iLWm22eKeX4OVWWNojR/qqP5b5ZDw4QQNhLxzsgEQuPgfcqpGQNglCOOs11ACZVIFU1+eY4bhyAYc4WrWEkoqGQ==',key_name='tempest-TestVolumeBootPattern-2105905581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-4ayeigdw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:17:32Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=bd8e6fae-5355-449f-a552-e90f74d189d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:30:ef,bridge_name='br-int',has_traffic_filtering=True,id=60e68362-04fe-4c9a-8c48-2d065c5b6fea,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60e68362-04') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG os_vif [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:30:ef,bridge_name='br-int',has_traffic_filtering=True,id=60e68362-04fe-4c9a-8c48-2d065c5b6fea,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60e68362-04') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbefae15-9c25-561e-9e90-de7299340465', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60e68362-04, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60e68362-04, col_values=(('qos', UUID('7b8dd958-33ff-4f02-b4cf-338c6698a97c')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60e68362-04, col_values=(('external_ids', {'iface-id': '60e68362-04fe-4c9a-8c48-2d065c5b6fea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:30:ef', 'vm-uuid': 'bd8e6fae-5355-449f-a552-e90f74d189d7'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:39 user nova-compute[75342]: INFO os_vif [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:30:ef,bridge_name='br-int',has_traffic_filtering=True,id=60e68362-04fe-4c9a-8c48-2d065c5b6fea,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60e68362-04')
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:17:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No VIF found with MAC fa:16:3e:a9:30:ef, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-729a0089-8e48-4b02-b57c-270bf3391035 req-4cf5f1b0-1f44-42b9-beea-cf6b12c7881a service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received event network-vif-plugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-729a0089-8e48-4b02-b57c-270bf3391035 req-4cf5f1b0-1f44-42b9-beea-cf6b12c7881a service nova] Acquiring lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-729a0089-8e48-4b02-b57c-270bf3391035 req-4cf5f1b0-1f44-42b9-beea-cf6b12c7881a service nova] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-729a0089-8e48-4b02-b57c-270bf3391035 req-4cf5f1b0-1f44-42b9-beea-cf6b12c7881a service nova] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-729a0089-8e48-4b02-b57c-270bf3391035 req-4cf5f1b0-1f44-42b9-beea-cf6b12c7881a service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] No waiting events found dispatching network-vif-plugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:17:41 user nova-compute[75342]: WARNING nova.compute.manager [req-729a0089-8e48-4b02-b57c-270bf3391035 req-4cf5f1b0-1f44-42b9-beea-cf6b12c7881a service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received unexpected event network-vif-plugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea for instance with vm_state building and task_state spawning.
Nov 16 18:17:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "120e116f-a0e5-406c-9883-6f173da89100" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "120e116f-a0e5-406c-9883-6f173da89100" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "120e116f-a0e5-406c-9883-6f173da89100-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "120e116f-a0e5-406c-9883-6f173da89100-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "120e116f-a0e5-406c-9883-6f173da89100-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:41 user nova-compute[75342]: INFO nova.compute.manager [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Terminating instance
Nov 16 18:17:41 user nova-compute[75342]: DEBUG nova.compute.manager [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-1b59e7a1-46fc-445b-8849-ef505f3d6a0f req-b87a01ca-acb2-4eda-9330-7dd83749d448 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Received event network-vif-unplugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1b59e7a1-46fc-445b-8849-ef505f3d6a0f req-b87a01ca-acb2-4eda-9330-7dd83749d448 service nova] Acquiring lock "120e116f-a0e5-406c-9883-6f173da89100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1b59e7a1-46fc-445b-8849-ef505f3d6a0f req-b87a01ca-acb2-4eda-9330-7dd83749d448 service nova] Lock "120e116f-a0e5-406c-9883-6f173da89100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1b59e7a1-46fc-445b-8849-ef505f3d6a0f req-b87a01ca-acb2-4eda-9330-7dd83749d448 service nova] Lock "120e116f-a0e5-406c-9883-6f173da89100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-1b59e7a1-46fc-445b-8849-ef505f3d6a0f req-b87a01ca-acb2-4eda-9330-7dd83749d448 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] No waiting events found dispatching network-vif-unplugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-1b59e7a1-46fc-445b-8849-ef505f3d6a0f req-b87a01ca-acb2-4eda-9330-7dd83749d448 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Received event network-vif-unplugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Instance destroyed successfully.
Nov 16 18:17:42 user nova-compute[75342]: DEBUG nova.objects.instance [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'resources' on Instance uuid 120e116f-a0e5-406c-9883-6f173da89100 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-717253090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-717253090',id=26,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:08:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-8jtyrc1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:10:15Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=120e116f-a0e5-406c-9883-6f173da89100,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "address": "fa:16:3e:0b:b9:34", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2bea56-51", "ovs_interfaceid": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "address": "fa:16:3e:0b:b9:34", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2bea56-51", "ovs_interfaceid": "7e2bea56-517c-4a7c-aec3-4b9f951e2605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:34,bridge_name='br-int',has_traffic_filtering=True,id=7e2bea56-517c-4a7c-aec3-4b9f951e2605,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2bea56-51') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG os_vif [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:34,bridge_name='br-int',has_traffic_filtering=True,id=7e2bea56-517c-4a7c-aec3-4b9f951e2605,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2bea56-51') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e2bea56-51, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36141431-e559-4471-96bb-3f64ca59df57) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:17:42 user nova-compute[75342]: INFO os_vif [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:34,bridge_name='br-int',has_traffic_filtering=True,id=7e2bea56-517c-4a7c-aec3-4b9f951e2605,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2bea56-51')
Nov 16 18:17:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Deleting instance files /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100_del
Nov 16 18:17:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Deletion of /opt/stack/data/nova/instances/120e116f-a0e5-406c-9883-6f173da89100_del complete
Nov 16 18:17:42 user nova-compute[75342]: INFO nova.compute.manager [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 18:17:42 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 120e116f-a0e5-406c-9883-6f173da89100] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:17:42 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:17:42 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Took 0.53 seconds to deallocate network for instance.
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:43 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Deleted allocations for instance 120e116f-a0e5-406c-9883-6f173da89100
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:17:43 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Instance spawned successfully.
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-3fdfe157-9ea6-4a8d-86b3-921cfae66bc2 req-52842445-580e-4018-b6f3-8e0a9b3e374b service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received event network-vif-plugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3fdfe157-9ea6-4a8d-86b3-921cfae66bc2 req-52842445-580e-4018-b6f3-8e0a9b3e374b service nova] Acquiring lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3fdfe157-9ea6-4a8d-86b3-921cfae66bc2 req-52842445-580e-4018-b6f3-8e0a9b3e374b service nova] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3fdfe157-9ea6-4a8d-86b3-921cfae66bc2 req-52842445-580e-4018-b6f3-8e0a9b3e374b service nova] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-3fdfe157-9ea6-4a8d-86b3-921cfae66bc2 req-52842445-580e-4018-b6f3-8e0a9b3e374b service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] No waiting events found dispatching network-vif-plugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:17:43 user nova-compute[75342]: WARNING nova.compute.manager [req-3fdfe157-9ea6-4a8d-86b3-921cfae66bc2 req-52842445-580e-4018-b6f3-8e0a9b3e374b service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received unexpected event network-vif-plugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea for instance with vm_state building and task_state spawning.
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-186697cd-88d8-44ef-9230-4f7c495b7e72 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "120e116f-a0e5-406c-9883-6f173da89100" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:43 user nova-compute[75342]: INFO nova.compute.manager [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:17:43 user nova-compute[75342]: INFO nova.compute.manager [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Took 12.79 seconds to build instance.
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-22e9d8bb-1ca8-4dd6-8a9f-814cef41b8ef tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.892s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:43 user nova-compute[75342]: INFO nova.compute.manager [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Terminating instance
Nov 16 18:17:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Received event network-vif-plugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] Acquiring lock "120e116f-a0e5-406c-9883-6f173da89100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] Lock "120e116f-a0e5-406c-9883-6f173da89100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] Lock "120e116f-a0e5-406c-9883-6f173da89100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] No waiting events found dispatching network-vif-plugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:17:44 user nova-compute[75342]: WARNING nova.compute.manager [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Received unexpected event network-vif-plugged-7e2bea56-517c-4a7c-aec3-4b9f951e2605 for instance with vm_state deleted and task_state None.
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] [instance: 120e116f-a0e5-406c-9883-6f173da89100] Received event network-vif-deleted-7e2bea56-517c-4a7c-aec3-4b9f951e2605 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-vif-unplugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] No waiting events found dispatching network-vif-unplugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-vif-unplugged-b0832714-4459-45d7-bf7f-acb458b04551 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] Acquiring lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] No waiting events found dispatching network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:17:44 user nova-compute[75342]: WARNING nova.compute.manager [req-98169ab4-6c49-40af-b26a-d857751c92bd req-80581c08-81e5-4262-b2e5-dfc3b2667302 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received unexpected event network-vif-plugged-b0832714-4459-45d7-bf7f-acb458b04551 for instance with vm_state active and task_state deleting.
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Instance destroyed successfully.
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.objects.instance [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'resources' on Instance uuid 147d9aee-cfd9-4e78-bf35-0ac7e16f6679 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1621983513',display_name='tempest-ServerActionsTestOtherA-server-1621983513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1621983513',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU1men7gMttl3YEQ2iX5okVvx4lpe2gNM2yccK4kETnd8Mrupb252faDCsR3+7xPoiSo7c4DSoVxYlsKd1dOtU+J4xVhSH7sXMEH8ib246uK8ZL45kAm/O/eMxS5d6eeQ==',key_name='tempest-keypair-357673672',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:13:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-1dkp454h',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=147d9aee-cfd9-4e78-bf35-0ac7e16f6679,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "b0832714-4459-45d7-bf7f-acb458b04551", "address": "fa:16:3e:12:a1:d8", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0832714-44", "ovs_interfaceid": "b0832714-4459-45d7-bf7f-acb458b04551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_vif [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0832714-44, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c1ffda0-a25a-4abd-a18e-a560ecc2fe9e) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:17:44 user nova-compute[75342]: INFO os_vif [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:a1:d8,bridge_name='br-int',has_traffic_filtering=True,id=b0832714-4459-45d7-bf7f-acb458b04551,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0832714-44')
Nov 16 18:17:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtrUQGuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:17:44 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a10206-02e4-48bf-9532-a5fbe613c782]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:17:44 user nova-compute[75342]: No targets found.
Nov 16 18:17:44 user nova-compute[75342]: iSNS:
Nov 16 18:17:44 user nova-compute[75342]: No targets found.
Nov 16 18:17:44 user nova-compute[75342]: STATIC:
Nov 16 18:17:44 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c
Nov 16 18:17:44 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:17:44 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:17:44 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:17:44 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:17:44 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:17:44 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da
Nov 16 18:17:44 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:17:44 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:17:44 user nova-compute[75342]: FIRMWARE:
Nov 16 18:17:44 user nova-compute[75342]: No targets found.
Nov 16 18:17:44 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:17:44 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:17:44 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f0f5f-8ec6-4255-a73b-8ff7b22f552d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[be77ec23-6f34-49a6-aa27-0a944df3956e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:17:44 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:17:44 user nova-compute[75342]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:17:44 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:17:44 user nova-compute[75342]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c (non-flash)
Nov 16 18:17:44 user nova-compute[75342]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:17:44 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c861caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e7502b-1f02-43f9-a05f-de2315c9259d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef7bf6a-8f3b-419f-952c-7ae6bb850048]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe04ea2-7dd4-4d12-a7ea-2e794040bb02]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[481ad817-a912-4b57-bb98-c723c54ba979]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e4a93adc', '/dev/disk/by-id/scsi-1SCST_BIOe4a93adc-ae14385da59b97f2', '/dev/disk/by-id/scsi-26165313433383564') {{(pid=85570) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 18:17:44 user nova-compute[75342]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e4a93adc
Nov 16 18:17:44 user nova-compute[75342]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe4a93adc-ae14385da59b97f2
Nov 16 18:17:44 user nova-compute[75342]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26165313433383564
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a35958-1549-442f-8bcd-44b3f936976d]: (4, None) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[85789477-79ec-47c2-aae2-554f24242379]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[264d7479-538f-435f-9a6b-0d8833e8abbd]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260]
Nov 16 18:17:44 user nova-compute[75342]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c, portal: 172.16.0.220,3260] successful.
Nov 16 18:17:44 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62eb0bc9-da13-416b-ae9d-1bf9d700996c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e436e8-2b86-4caf-bd11-6e85995488a6]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] <== disconnect_volume: return (386ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:17:45 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Deleting instance files /opt/stack/data/nova/instances/147d9aee-cfd9-4e78-bf35-0ac7e16f6679_del
Nov 16 18:17:45 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Deletion of /opt/stack/data/nova/instances/147d9aee-cfd9-4e78-bf35-0ac7e16f6679_del complete
Nov 16 18:17:45 user nova-compute[75342]: INFO nova.compute.manager [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 16 18:17:45 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:17:45 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:17:45 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Took 0.83 seconds to deallocate network for instance.
Nov 16 18:17:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-1996b41e-414b-4c27-b010-565e38c389bd req-db6c7d0d-7b3b-4030-8c2c-13ad3afc0589 service nova] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Received event network-vif-deleted-b0832714-4459-45d7-bf7f-acb458b04551 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:17:46 user nova-compute[75342]: INFO nova.compute.manager [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Took 0.81 seconds to detach 1 volumes for instance.
Nov 16 18:17:46 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 147d9aee-cfd9-4e78-bf35-0ac7e16f6679] Deleting volume: 62eb0bc9-da13-416b-ae9d-1bf9d700996c {{(pid=75342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 18:17:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:47 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:17:47 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:17:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:47 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Deleted allocations for instance 147d9aee-cfd9-4e78-bf35-0ac7e16f6679
Nov 16 18:17:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:17:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e99fe04a-7fd2-44dc-9fae-50249ea5c97a tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "147d9aee-cfd9-4e78-bf35-0ac7e16f6679" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.591s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:17:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:17:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:17:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:17:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:53 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:17:53 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:17:53 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=7929MB free_disk=25.117145538330078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:17:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:17:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 85cd3e12-187f-48ba-9753-e8e93787cdf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 78afab8c-3e7c-4697-86b8-726c6ed252c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c53c3ddf-a478-4692-81b0-1b3e403f0cea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bd8e6fae-5355-449f-a552-e90f74d189d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:17:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:17:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:17:56 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:17:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:17:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:17:56 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:17:56 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Updating instance_info_cache with network_info: [{"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:17:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:17:56 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:17:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:17:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:17:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:17:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:06 user nova-compute[75342]: INFO nova.compute.manager [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Terminating instance
Nov 16 18:18:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-24b4bdb8-c48d-4487-bfa3-5451303badf4 req-3a8d2f49-1f15-49ee-b02c-bd2bb41bac22 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-24b4bdb8-c48d-4487-bfa3-5451303badf4 req-3a8d2f49-1f15-49ee-b02c-bd2bb41bac22 service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-24b4bdb8-c48d-4487-bfa3-5451303badf4 req-3a8d2f49-1f15-49ee-b02c-bd2bb41bac22 service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-24b4bdb8-c48d-4487-bfa3-5451303badf4 req-3a8d2f49-1f15-49ee-b02c-bd2bb41bac22 service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-24b4bdb8-c48d-4487-bfa3-5451303badf4 req-3a8d2f49-1f15-49ee-b02c-bd2bb41bac22 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-24b4bdb8-c48d-4487-bfa3-5451303badf4 req-3a8d2f49-1f15-49ee-b02c-bd2bb41bac22 service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-unplugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Instance destroyed successfully.
Nov 16 18:18:07 user nova-compute[75342]: DEBUG nova.objects.instance [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'resources' on Instance uuid 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-312026651',display_name='tempest-ServerRescueNegativeTestJSON-server-312026651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-312026651',id=34,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA26q3PLEG430qQKUG7KVHVR1G1xH6/5zkOYUuj6Uf9b3zgk5ntrZk6vFHpepH7LfPKXhlO8sApShsL0bdYrqRWyzpKEe2UwkxAz2JacyKrsu43gCO+MYiAcuvjbmWvpKg==',key_name='tempest-keypair-614923427',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:13:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-gli1u0lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:15:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "01f59d58-7783-45da-bc6c-5834a6924118", "address": "fa:16:3e:1e:4f:cc", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f59d58-77", "ovs_interfaceid": "01f59d58-7783-45da-bc6c-5834a6924118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:cc,bridge_name='br-int',has_traffic_filtering=True,id=01f59d58-7783-45da-bc6c-5834a6924118,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f59d58-77') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG os_vif [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:cc,bridge_name='br-int',has_traffic_filtering=True,id=01f59d58-7783-45da-bc6c-5834a6924118,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f59d58-77') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01f59d58-77, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7349448-51ab-4fce-8a8b-350fb53c86a6) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:18:07 user nova-compute[75342]: INFO os_vif [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:cc,bridge_name='br-int',has_traffic_filtering=True,id=01f59d58-7783-45da-bc6c-5834a6924118,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f59d58-77')
Nov 16 18:18:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Deleting instance files /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c_del
Nov 16 18:18:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Deletion of /opt/stack/data/nova/instances/9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c_del complete
Nov 16 18:18:07 user nova-compute[75342]: INFO nova.compute.manager [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 16 18:18:07 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:07 user nova-compute[75342]: INFO nova.compute.manager [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Terminating instance
Nov 16 18:18:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:18:08 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Took 0.73 seconds to deallocate network for instance.
Nov 16 18:18:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-f065c9df-9ebd-4f31-b374-7d72bf9de048 req-e0ef5734-6bab-4df5-8b45-553b71fc306f service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Received event network-vif-unplugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f065c9df-9ebd-4f31-b374-7d72bf9de048 req-e0ef5734-6bab-4df5-8b45-553b71fc306f service nova] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f065c9df-9ebd-4f31-b374-7d72bf9de048 req-e0ef5734-6bab-4df5-8b45-553b71fc306f service nova] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f065c9df-9ebd-4f31-b374-7d72bf9de048 req-e0ef5734-6bab-4df5-8b45-553b71fc306f service nova] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-f065c9df-9ebd-4f31-b374-7d72bf9de048 req-e0ef5734-6bab-4df5-8b45-553b71fc306f service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] No waiting events found dispatching network-vif-unplugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-f065c9df-9ebd-4f31-b374-7d72bf9de048 req-e0ef5734-6bab-4df5-8b45-553b71fc306f service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Received event network-vif-unplugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:18:08 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Instance destroyed successfully.
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.objects.instance [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lazy-loading 'resources' on Instance uuid c53c3ddf-a478-4692-81b0-1b3e403f0cea {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2136336470',display_name='tempest-TestServerVolumeAttachmentScenario-server-2136336470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2136336470',id=35,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEgWgtXVjvlvc+0jBP2XzrV+ixRMPpLNdTrr5gkPCXVsQkvJIBhDinYMQ8Z60PWxUjg5tybTTHX4nU4spfr2tzB70ZPVUsMc/OXv9DgIZe3pwVsmZaYHcNynJtrjlTA9Q==',key_name='tempest-keypair-1778937027',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:14:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb2189db5a95468dbf66c195eb817345',ramdisk_id='',reservation_id='r-agn8cp8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1576288846',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1576288846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:14:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='864edacddf7b48e4aaf60fd93cafb684',uuid=c53c3ddf-a478-4692-81b0-1b3e403f0cea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "address": "fa:16:3e:b6:12:d4", "network": {"id": "ca4da789-6833-4b42-bbb2-d90a38f7e1b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110095711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2189db5a95468dbf66c195eb817345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c08917-db", "ovs_interfaceid": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Converting VIF {"id": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "address": "fa:16:3e:b6:12:d4", "network": {"id": "ca4da789-6833-4b42-bbb2-d90a38f7e1b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1110095711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2189db5a95468dbf66c195eb817345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c08917-db", "ovs_interfaceid": "b1c08917-dbca-468f-92ac-12cdf2c61fc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:12:d4,bridge_name='br-int',has_traffic_filtering=True,id=b1c08917-dbca-468f-92ac-12cdf2c61fc5,network=Network(ca4da789-6833-4b42-bbb2-d90a38f7e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c08917-db') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG os_vif [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:12:d4,bridge_name='br-int',has_traffic_filtering=True,id=b1c08917-dbca-468f-92ac-12cdf2c61fc5,network=Network(ca4da789-6833-4b42-bbb2-d90a38f7e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c08917-db') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1c08917-db, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc9c9683-0660-4774-b5bc-b997362f4b06) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:08 user nova-compute[75342]: INFO os_vif [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:12:d4,bridge_name='br-int',has_traffic_filtering=True,id=b1c08917-dbca-468f-92ac-12cdf2c61fc5,network=Network(ca4da789-6833-4b42-bbb2-d90a38f7e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c08917-db')
Nov 16 18:18:08 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Deleting instance files /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea_del
Nov 16 18:18:08 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Deletion of /opt/stack/data/nova/instances/c53c3ddf-a478-4692-81b0-1b3e403f0cea_del complete
Nov 16 18:18:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:18:08 user nova-compute[75342]: INFO nova.compute.manager [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 18:18:08 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:08 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Deleted allocations for instance 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c
Nov 16 18:18:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-55bd9c0e-fd66-42eb-b5a6-7e93be9540b5 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.232s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-e22e4178-db1e-4995-9e03-c7231dab593d req-752d2731-5ac5-4763-8153-261d3888a69e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e22e4178-db1e-4995-9e03-c7231dab593d req-752d2731-5ac5-4763-8153-261d3888a69e service nova] Acquiring lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e22e4178-db1e-4995-9e03-c7231dab593d req-752d2731-5ac5-4763-8153-261d3888a69e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e22e4178-db1e-4995-9e03-c7231dab593d req-752d2731-5ac5-4763-8153-261d3888a69e service nova] Lock "9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-e22e4178-db1e-4995-9e03-c7231dab593d req-752d2731-5ac5-4763-8153-261d3888a69e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] No waiting events found dispatching network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:18:08 user nova-compute[75342]: WARNING nova.compute.manager [req-e22e4178-db1e-4995-9e03-c7231dab593d req-752d2731-5ac5-4763-8153-261d3888a69e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received unexpected event network-vif-plugged-01f59d58-7783-45da-bc6c-5834a6924118 for instance with vm_state deleted and task_state None.
Nov 16 18:18:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-e22e4178-db1e-4995-9e03-c7231dab593d req-752d2731-5ac5-4763-8153-261d3888a69e service nova] [instance: 9220a2fb-f5b4-40a5-a4ba-80bcb1968a4c] Received event network-vif-deleted-01f59d58-7783-45da-bc6c-5834a6924118 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:09 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:18:09 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Took 1.13 seconds to deallocate network for instance.
Nov 16 18:18:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:10 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:18:10 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:18:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:10 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Deleted allocations for instance c53c3ddf-a478-4692-81b0-1b3e403f0cea
Nov 16 18:18:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2565376d-376b-40d8-b531-25a1af048284 tempest-TestServerVolumeAttachmentScenario-1576288846 tempest-TestServerVolumeAttachmentScenario-1576288846-project-member] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.430s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-94fcc2ca-97bd-4271-8d35-0bd4782fe31f req-2ff5fac9-15ff-49dc-ba01-08ae0488fc9d service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Received event network-vif-plugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-94fcc2ca-97bd-4271-8d35-0bd4782fe31f req-2ff5fac9-15ff-49dc-ba01-08ae0488fc9d service nova] Acquiring lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-94fcc2ca-97bd-4271-8d35-0bd4782fe31f req-2ff5fac9-15ff-49dc-ba01-08ae0488fc9d service nova] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-94fcc2ca-97bd-4271-8d35-0bd4782fe31f req-2ff5fac9-15ff-49dc-ba01-08ae0488fc9d service nova] Lock "c53c3ddf-a478-4692-81b0-1b3e403f0cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-94fcc2ca-97bd-4271-8d35-0bd4782fe31f req-2ff5fac9-15ff-49dc-ba01-08ae0488fc9d service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] No waiting events found dispatching network-vif-plugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:18:10 user nova-compute[75342]: WARNING nova.compute.manager [req-94fcc2ca-97bd-4271-8d35-0bd4782fe31f req-2ff5fac9-15ff-49dc-ba01-08ae0488fc9d service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Received unexpected event network-vif-plugged-b1c08917-dbca-468f-92ac-12cdf2c61fc5 for instance with vm_state deleted and task_state None.
Nov 16 18:18:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-fd399b95-3b88-42b2-96cb-3be1ce051a0f req-bc6ba555-ff3f-4f57-abd1-88aad5157aa6 service nova] [instance: c53c3ddf-a478-4692-81b0-1b3e403f0cea] Received event network-vif-deleted-b1c08917-dbca-468f-92ac-12cdf2c61fc5 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:18:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:18:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:18:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:18:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:32 user nova-compute[75342]: INFO nova.compute.manager [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Terminating instance
Nov 16 18:18:32 user nova-compute[75342]: DEBUG nova.compute.manager [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-9a214c53-ca84-4549-bd34-870248c22e1e req-543692a8-52ab-4fcf-a97f-642fa20ccf96 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-unplugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9a214c53-ca84-4549-bd34-870248c22e1e req-543692a8-52ab-4fcf-a97f-642fa20ccf96 service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9a214c53-ca84-4549-bd34-870248c22e1e req-543692a8-52ab-4fcf-a97f-642fa20ccf96 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9a214c53-ca84-4549-bd34-870248c22e1e req-543692a8-52ab-4fcf-a97f-642fa20ccf96 service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-9a214c53-ca84-4549-bd34-870248c22e1e req-543692a8-52ab-4fcf-a97f-642fa20ccf96 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-unplugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-9a214c53-ca84-4549-bd34-870248c22e1e req-543692a8-52ab-4fcf-a97f-642fa20ccf96 service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-unplugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:18:32 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Instance destroyed successfully.
Nov 16 18:18:32 user nova-compute[75342]: DEBUG nova.objects.instance [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'resources' on Instance uuid 78afab8c-3e7c-4697-86b8-726c6ed252c5 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670881738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670881738',id=13,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:04:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-f1kum1ys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:06:31Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=78afab8c-3e7c-4697-86b8-726c6ed252c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "3412866c-1a34-4be9-91b5-37959486c6cc", "address": "fa:16:3e:32:a2:86", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3412866c-1a", "ovs_interfaceid": "3412866c-1a34-4be9-91b5-37959486c6cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=3412866c-1a34-4be9-91b5-37959486c6cc,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3412866c-1a') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG os_vif [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=3412866c-1a34-4be9-91b5-37959486c6cc,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3412866c-1a') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3412866c-1a, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed80ecfa-8ffa-4dcc-b2cd-db8f55630405) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:32 user nova-compute[75342]: INFO os_vif [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:a2:86,bridge_name='br-int',has_traffic_filtering=True,id=3412866c-1a34-4be9-91b5-37959486c6cc,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3412866c-1a')
Nov 16 18:18:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbNZPLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:18:32 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:18:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[93374b62-a320-44ef-b783-1abe1dcda6e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:18:32 user nova-compute[75342]: No targets found.
Nov 16 18:18:32 user nova-compute[75342]: iSNS:
Nov 16 18:18:32 user nova-compute[75342]: No targets found.
Nov 16 18:18:32 user nova-compute[75342]: STATIC:
Nov 16 18:18:32 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5
Nov 16 18:18:32 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:18:32 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:18:32 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da
Nov 16 18:18:32 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:18:32 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:18:32 user nova-compute[75342]: FIRMWARE:
Nov 16 18:18:32 user nova-compute[75342]: No targets found.
Nov 16 18:18:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:18:32 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:18:32 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf43561e-07ba-4a4a-9c48-4118dd332579]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c1b2bb-0432-41a0-9936-bb5920d5b164]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:18:32 user nova-compute[75342]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:18:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 (non-flash)
Nov 16 18:18:32 user nova-compute[75342]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:18:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c861c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5'): ({'sdd'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Removing single pathed devices sdd {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:18:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[00792dcd-8c60-4f18-8cf5-40b54ff564a7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd579ada-ab92-463a-888c-be7917a6350a]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Flushing IO for device /dev/sdd {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb534e8-a0cb-42da-b7f9-062bf0fbde9d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[224aba94-24a7-43f4-96b5-825bf32cca46]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[179649d4-3ed4-4fbb-8f97-448cc28d6687]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5858b3-6ccd-4b3f-9da7-6b8155d0008f]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5, portal: 172.16.0.220,3260]
Nov 16 18:18:33 user nova-compute[75342]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5, portal: 172.16.0.220,3260] successful.
Nov 16 18:18:33 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c489a9d8-65ca-4fc0-baa2-8ad3f7dbd0c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2703d876-a8e6-4bd3-83e3-beddc00d89f4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] <== disconnect_volume: return (289ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:18:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Deleting instance files /opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5_del
Nov 16 18:18:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Deletion of /opt/stack/data/nova/instances/78afab8c-3e7c-4697-86b8-726c6ed252c5_del complete
Nov 16 18:18:33 user nova-compute[75342]: INFO nova.compute.manager [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 16 18:18:33 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:33 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:18:33 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Took 0.50 seconds to deallocate network for instance.
Nov 16 18:18:33 user nova-compute[75342]: DEBUG nova.compute.manager [req-e3e366b0-016b-4934-9e38-d745e4de3f11 req-80815727-e317-4705-819e-d9172440622d service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-deleted-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-062ef37b-61ee-4196-a32a-174e5ef3b5d4 req-b75ad4f2-e941-4108-bc10-1ee3652e89be service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-062ef37b-61ee-4196-a32a-174e5ef3b5d4 req-b75ad4f2-e941-4108-bc10-1ee3652e89be service nova] Acquiring lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-062ef37b-61ee-4196-a32a-174e5ef3b5d4 req-b75ad4f2-e941-4108-bc10-1ee3652e89be service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-062ef37b-61ee-4196-a32a-174e5ef3b5d4 req-b75ad4f2-e941-4108-bc10-1ee3652e89be service nova] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-062ef37b-61ee-4196-a32a-174e5ef3b5d4 req-b75ad4f2-e941-4108-bc10-1ee3652e89be service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] No waiting events found dispatching network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:18:34 user nova-compute[75342]: WARNING nova.compute.manager [req-062ef37b-61ee-4196-a32a-174e5ef3b5d4 req-b75ad4f2-e941-4108-bc10-1ee3652e89be service nova] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Received unexpected event network-vif-plugged-3412866c-1a34-4be9-91b5-37959486c6cc for instance with vm_state active and task_state deleting.
Nov 16 18:18:34 user nova-compute[75342]: INFO nova.compute.manager [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 78afab8c-3e7c-4697-86b8-726c6ed252c5] Took 1.09 seconds to detach 1 volumes for instance.
Nov 16 18:18:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:35 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:18:35 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:18:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:35 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Deleted allocations for instance 78afab8c-3e7c-4697-86b8-726c6ed252c5
Nov 16 18:18:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-86a0d91c-5262-449a-ae36-e3e87169b51f tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "78afab8c-3e7c-4697-86b8-726c6ed252c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.402s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:38 user nova-compute[75342]: INFO nova.compute.manager [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Terminating instance
Nov 16 18:18:38 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-5ec76de2-21ee-4064-93a5-9e312342d72a req-9208c05d-21e2-481a-ba28-f0d5f81612f6 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received event network-vif-unplugged-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5ec76de2-21ee-4064-93a5-9e312342d72a req-9208c05d-21e2-481a-ba28-f0d5f81612f6 service nova] Acquiring lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5ec76de2-21ee-4064-93a5-9e312342d72a req-9208c05d-21e2-481a-ba28-f0d5f81612f6 service nova] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5ec76de2-21ee-4064-93a5-9e312342d72a req-9208c05d-21e2-481a-ba28-f0d5f81612f6 service nova] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-5ec76de2-21ee-4064-93a5-9e312342d72a req-9208c05d-21e2-481a-ba28-f0d5f81612f6 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] No waiting events found dispatching network-vif-unplugged-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:18:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-5ec76de2-21ee-4064-93a5-9e312342d72a req-9208c05d-21e2-481a-ba28-f0d5f81612f6 service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received event network-vif-unplugged-90788e52-2039-4374-bf9a-a77637f0752d for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:18:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Instance destroyed successfully.
Nov 16 18:18:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lazy-loading 'resources' on Instance uuid 85cd3e12-187f-48ba-9753-e8e93787cdf4 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-228468433',display_name='tempest-ServerActionsTestOtherA-server-228468433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-228468433',id=1,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU1men7gMttl3YEQ2iX5okVvx4lpe2gNM2yccK4kETnd8Mrupb252faDCsR3+7xPoiSo7c4DSoVxYlsKd1dOtU+J4xVhSH7sXMEH8ib246uK8ZL45kAm/O/eMxS5d6eeQ==',key_name='tempest-keypair-357673672',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c78cae892fff433eb216caff3a127a64',ramdisk_id='',reservation_id='r-rogh2o84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1650562087',owner_user_name='tempest-ServerActionsTestOtherA-1650562087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:00:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1794b9bef4ad42e6aab088f3ef90dba2',uuid=85cd3e12-187f-48ba-9753-e8e93787cdf4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converting VIF {"id": "90788e52-2039-4374-bf9a-a77637f0752d", "address": "fa:16:3e:7a:80:ac", "network": {"id": "9f081d2f-78fa-45e5-9db6-de9f7222a359", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-128155851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c78cae892fff433eb216caff3a127a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90788e52-20", "ovs_interfaceid": "90788e52-2039-4374-bf9a-a77637f0752d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=90788e52-2039-4374-bf9a-a77637f0752d,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90788e52-20') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG os_vif [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=90788e52-2039-4374-bf9a-a77637f0752d,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90788e52-20') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90788e52-20, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6556247b-2a96-4345-9dd7-156b0f95e91d) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:18:39 user nova-compute[75342]: INFO os_vif [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:80:ac,bridge_name='br-int',has_traffic_filtering=True,id=90788e52-2039-4374-bf9a-a77637f0752d,network=Network(9f081d2f-78fa-45e5-9db6-de9f7222a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90788e52-20')
Nov 16 18:18:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Deleting instance files /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4_del
Nov 16 18:18:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Deletion of /opt/stack/data/nova/instances/85cd3e12-187f-48ba-9753-e8e93787cdf4_del complete
Nov 16 18:18:39 user nova-compute[75342]: INFO nova.compute.manager [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 16 18:18:39 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:18:39 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:18:40 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:18:40 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Took 0.47 seconds to deallocate network for instance.
Nov 16 18:18:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:40 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:18:40 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:18:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:40 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Deleted allocations for instance 85cd3e12-187f-48ba-9753-e8e93787cdf4
Nov 16 18:18:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c86ebb03-dc77-4e58-b990-a0c775e7896b tempest-ServerActionsTestOtherA-1650562087 tempest-ServerActionsTestOtherA-1650562087-project-member] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.806s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-3c18b369-b7a7-49c7-a1bd-e5953371dfbc req-0a0bd7f3-d8c9-476b-8870-09ad0f77674d service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received event network-vif-plugged-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3c18b369-b7a7-49c7-a1bd-e5953371dfbc req-0a0bd7f3-d8c9-476b-8870-09ad0f77674d service nova] Acquiring lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3c18b369-b7a7-49c7-a1bd-e5953371dfbc req-0a0bd7f3-d8c9-476b-8870-09ad0f77674d service nova] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3c18b369-b7a7-49c7-a1bd-e5953371dfbc req-0a0bd7f3-d8c9-476b-8870-09ad0f77674d service nova] Lock "85cd3e12-187f-48ba-9753-e8e93787cdf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-3c18b369-b7a7-49c7-a1bd-e5953371dfbc req-0a0bd7f3-d8c9-476b-8870-09ad0f77674d service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] No waiting events found dispatching network-vif-plugged-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:18:41 user nova-compute[75342]: WARNING nova.compute.manager [req-3c18b369-b7a7-49c7-a1bd-e5953371dfbc req-0a0bd7f3-d8c9-476b-8870-09ad0f77674d service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received unexpected event network-vif-plugged-90788e52-2039-4374-bf9a-a77637f0752d for instance with vm_state deleted and task_state None.
Nov 16 18:18:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-3c18b369-b7a7-49c7-a1bd-e5953371dfbc req-0a0bd7f3-d8c9-476b-8870-09ad0f77674d service nova] [instance: 85cd3e12-187f-48ba-9753-e8e93787cdf4] Received event network-vif-deleted-90788e52-2039-4374-bf9a-a77637f0752d {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Acquiring lock "c9e9c604-3ed1-4162-b30e-629f34748c87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:18:45 user nova-compute[75342]: INFO nova.compute.claims [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Claim successful on node user
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:18:45 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:18:45 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Creating image(s)
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "/opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "/opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG nova.policy [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54fed81f64cd4b7482325a8ac6e4c1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18bddcf9be84795bd84ea4357099937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.168s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk 1073741824" returned: 0 in 0.045s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Cannot resize image /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Ensure instance console log exists: /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Successfully created port: f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Successfully updated port: f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Acquiring lock "refresh_cache-c9e9c604-3ed1-4162-b30e-629f34748c87" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Acquired lock "refresh_cache-c9e9c604-3ed1-4162-b30e-629f34748c87" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-3d939968-2539-4e1e-8eab-caad06cafb40 req-6ee11f55-2716-4259-81d9-ae1741fb1d5b service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Received event network-changed-f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-3d939968-2539-4e1e-8eab-caad06cafb40 req-6ee11f55-2716-4259-81d9-ae1741fb1d5b service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Refreshing instance network info cache due to event network-changed-f327819a-a3a9-4a62-af5b-93eb4581e280. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d939968-2539-4e1e-8eab-caad06cafb40 req-6ee11f55-2716-4259-81d9-ae1741fb1d5b service nova] Acquiring lock "refresh_cache-c9e9c604-3ed1-4162-b30e-629f34748c87" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Updating instance_info_cache with network_info: [{"id": "f327819a-a3a9-4a62-af5b-93eb4581e280", "address": "fa:16:3e:ae:6f:00", "network": {"id": "4f021b06-bd26-4245-a06c-ce3555653e07", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cde44693ac4d4e6aa4874162714c9ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf327819a-a3", "ovs_interfaceid": "f327819a-a3a9-4a62-af5b-93eb4581e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Releasing lock "refresh_cache-c9e9c604-3ed1-4162-b30e-629f34748c87" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Instance network_info: |[{"id": "f327819a-a3a9-4a62-af5b-93eb4581e280", "address": "fa:16:3e:ae:6f:00", "network": {"id": "4f021b06-bd26-4245-a06c-ce3555653e07", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cde44693ac4d4e6aa4874162714c9ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf327819a-a3", "ovs_interfaceid": "f327819a-a3a9-4a62-af5b-93eb4581e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d939968-2539-4e1e-8eab-caad06cafb40 req-6ee11f55-2716-4259-81d9-ae1741fb1d5b service nova] Acquired lock "refresh_cache-c9e9c604-3ed1-4162-b30e-629f34748c87" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.network.neutron [req-3d939968-2539-4e1e-8eab-caad06cafb40 req-6ee11f55-2716-4259-81d9-ae1741fb1d5b service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Refreshing network info cache for port f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Start _get_guest_xml network_info=[{"id": "f327819a-a3a9-4a62-af5b-93eb4581e280", "address": "fa:16:3e:ae:6f:00", "network": {"id": "4f021b06-bd26-4245-a06c-ce3555653e07", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cde44693ac4d4e6aa4874162714c9ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf327819a-a3", "ovs_interfaceid": "f327819a-a3a9-4a62-af5b-93eb4581e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:18:47 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:18:47 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1926772768',display_name='tempest-VolumesNegativeTest-instance-1926772768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1926772768',id=39,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e18bddcf9be84795bd84ea4357099937',ramdisk_id='',reservation_id='r-nb6035lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1852274216',owner_user_name='tempest-VolumesNegativeTest-1852274216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:18:46Z,user_data=None,user_id='54fed81f64cd4b7482325a8ac6e4c1b4',uuid=c9e9c604-3ed1-4162-b30e-629f34748c87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f327819a-a3a9-4a62-af5b-93eb4581e280", "address": "fa:16:3e:ae:6f:00", "network": {"id": "4f021b06-bd26-4245-a06c-ce3555653e07", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cde44693ac4d4e6aa4874162714c9ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf327819a-a3", "ovs_interfaceid": "f327819a-a3a9-4a62-af5b-93eb4581e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Converting VIF {"id": "f327819a-a3a9-4a62-af5b-93eb4581e280", "address": "fa:16:3e:ae:6f:00", "network": {"id": "4f021b06-bd26-4245-a06c-ce3555653e07", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cde44693ac4d4e6aa4874162714c9ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf327819a-a3", "ovs_interfaceid": "f327819a-a3a9-4a62-af5b-93eb4581e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:6f:00,bridge_name='br-int',has_traffic_filtering=True,id=f327819a-a3a9-4a62-af5b-93eb4581e280,network=Network(4f021b06-bd26-4245-a06c-ce3555653e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf327819a-a3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.objects.instance [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lazy-loading 'pci_devices' on Instance uuid c9e9c604-3ed1-4162-b30e-629f34748c87 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:18:47 user nova-compute[75342]:   <uuid>c9e9c604-3ed1-4162-b30e-629f34748c87</uuid>
Nov 16 18:18:47 user nova-compute[75342]:   <name>instance-00000027</name>
Nov 16 18:18:47 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:18:47 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:18:47 user nova-compute[75342]:   <metadata>
Nov 16 18:18:47 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:18:47 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:18:47 user nova-compute[75342]:       <nova:name>tempest-VolumesNegativeTest-instance-1926772768</nova:name>
Nov 16 18:18:47 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:18:47</nova:creationTime>
Nov 16 18:18:47 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:18:47 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:18:47 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:18:47 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:18:47 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:18:47 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:18:47 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:18:47 user nova-compute[75342]:       <nova:owner>
Nov 16 18:18:47 user nova-compute[75342]:         <nova:user uuid="54fed81f64cd4b7482325a8ac6e4c1b4">tempest-VolumesNegativeTest-1852274216-project-member</nova:user>
Nov 16 18:18:47 user nova-compute[75342]:         <nova:project uuid="e18bddcf9be84795bd84ea4357099937">tempest-VolumesNegativeTest-1852274216</nova:project>
Nov 16 18:18:47 user nova-compute[75342]:       </nova:owner>
Nov 16 18:18:47 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:18:47 user nova-compute[75342]:       <nova:ports>
Nov 16 18:18:47 user nova-compute[75342]:         <nova:port uuid="f327819a-a3a9-4a62-af5b-93eb4581e280">
Nov 16 18:18:47 user nova-compute[75342]:           <nova:ip type="fixed" address="192.168.233.98" ipVersion="4"/>
Nov 16 18:18:47 user nova-compute[75342]:         </nova:port>
Nov 16 18:18:47 user nova-compute[75342]:       </nova:ports>
Nov 16 18:18:47 user nova-compute[75342]:     </nova:instance>
Nov 16 18:18:47 user nova-compute[75342]:   </metadata>
Nov 16 18:18:47 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:18:47 user nova-compute[75342]:     <system>
Nov 16 18:18:47 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:18:47 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:18:47 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:18:47 user nova-compute[75342]:       <entry name="serial">c9e9c604-3ed1-4162-b30e-629f34748c87</entry>
Nov 16 18:18:47 user nova-compute[75342]:       <entry name="uuid">c9e9c604-3ed1-4162-b30e-629f34748c87</entry>
Nov 16 18:18:47 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:18:47 user nova-compute[75342]:     </system>
Nov 16 18:18:47 user nova-compute[75342]:   </sysinfo>
Nov 16 18:18:47 user nova-compute[75342]:   <os>
Nov 16 18:18:47 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:18:47 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:18:47 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:18:47 user nova-compute[75342]:   </os>
Nov 16 18:18:47 user nova-compute[75342]:   <features>
Nov 16 18:18:47 user nova-compute[75342]:     <acpi/>
Nov 16 18:18:47 user nova-compute[75342]:     <apic/>
Nov 16 18:18:47 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:18:47 user nova-compute[75342]:   </features>
Nov 16 18:18:47 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:18:47 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:18:47 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:18:47 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:18:47 user nova-compute[75342]:   </clock>
Nov 16 18:18:47 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:18:47 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:18:47 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:18:47 user nova-compute[75342]:   </cpu>
Nov 16 18:18:47 user nova-compute[75342]:   <devices>
Nov 16 18:18:47 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:18:47 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:18:47 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk"/>
Nov 16 18:18:47 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:18:47 user nova-compute[75342]:     </disk>
Nov 16 18:18:47 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:18:47 user nova-compute[75342]:       <mac address="fa:16:3e:ae:6f:00"/>
Nov 16 18:18:47 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:18:47 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:18:47 user nova-compute[75342]:       <target dev="tapf327819a-a3"/>
Nov 16 18:18:47 user nova-compute[75342]:     </interface>
Nov 16 18:18:47 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:18:47 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/console.log" append="off"/>
Nov 16 18:18:47 user nova-compute[75342]:     </serial>
Nov 16 18:18:47 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:18:47 user nova-compute[75342]:     <video>
Nov 16 18:18:47 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:18:47 user nova-compute[75342]:     </video>
Nov 16 18:18:47 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:18:47 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:18:47 user nova-compute[75342]:     </rng>
Nov 16 18:18:47 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:18:47 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:18:47 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:18:47 user nova-compute[75342]:     </memballoon>
Nov 16 18:18:47 user nova-compute[75342]:   </devices>
Nov 16 18:18:47 user nova-compute[75342]: </domain>
Nov 16 18:18:47 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1926772768',display_name='tempest-VolumesNegativeTest-instance-1926772768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1926772768',id=39,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e18bddcf9be84795bd84ea4357099937',ramdisk_id='',reservation_id='r-nb6035lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1852274216',owner_user_name='tempest-VolumesNegativeTest-1852274216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:18:46Z,user_data=None,user_id='54fed81f64cd4b7482325a8ac6e4c1b4',uuid=c9e9c604-3ed1-4162-b30e-629f34748c87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f327819a-a3a9-4a62-af5b-93eb4581e280", "address": "fa:16:3e:ae:6f:00", "network": {"id": "4f021b06-bd26-4245-a06c-ce3555653e07", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cde44693ac4d4e6aa4874162714c9ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf327819a-a3", "ovs_interfaceid": "f327819a-a3a9-4a62-af5b-93eb4581e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Converting VIF {"id": "f327819a-a3a9-4a62-af5b-93eb4581e280", "address": "fa:16:3e:ae:6f:00", "network": {"id": "4f021b06-bd26-4245-a06c-ce3555653e07", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cde44693ac4d4e6aa4874162714c9ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf327819a-a3", "ovs_interfaceid": "f327819a-a3a9-4a62-af5b-93eb4581e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:6f:00,bridge_name='br-int',has_traffic_filtering=True,id=f327819a-a3a9-4a62-af5b-93eb4581e280,network=Network(4f021b06-bd26-4245-a06c-ce3555653e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf327819a-a3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG os_vif [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:6f:00,bridge_name='br-int',has_traffic_filtering=True,id=f327819a-a3a9-4a62-af5b-93eb4581e280,network=Network(4f021b06-bd26-4245-a06c-ce3555653e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf327819a-a3') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91849e8f-4249-5368-86e8-88b5645b5c2c', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf327819a-a3, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf327819a-a3, col_values=(('qos', UUID('2c555dcc-a581-4696-98ef-74558500b6d8')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf327819a-a3, col_values=(('external_ids', {'iface-id': 'f327819a-a3a9-4a62-af5b-93eb4581e280', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:6f:00', 'vm-uuid': 'c9e9c604-3ed1-4162-b30e-629f34748c87'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:47 user nova-compute[75342]: INFO os_vif [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:6f:00,bridge_name='br-int',has_traffic_filtering=True,id=f327819a-a3a9-4a62-af5b-93eb4581e280,network=Network(4f021b06-bd26-4245-a06c-ce3555653e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf327819a-a3')
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] No VIF found with MAC fa:16:3e:ae:6f:00, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.network.neutron [req-3d939968-2539-4e1e-8eab-caad06cafb40 req-6ee11f55-2716-4259-81d9-ae1741fb1d5b service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Updated VIF entry in instance network info cache for port f327819a-a3a9-4a62-af5b-93eb4581e280. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG nova.network.neutron [req-3d939968-2539-4e1e-8eab-caad06cafb40 req-6ee11f55-2716-4259-81d9-ae1741fb1d5b service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Updating instance_info_cache with network_info: [{"id": "f327819a-a3a9-4a62-af5b-93eb4581e280", "address": "fa:16:3e:ae:6f:00", "network": {"id": "4f021b06-bd26-4245-a06c-ce3555653e07", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cde44693ac4d4e6aa4874162714c9ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf327819a-a3", "ovs_interfaceid": "f327819a-a3a9-4a62-af5b-93eb4581e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:18:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3d939968-2539-4e1e-8eab-caad06cafb40 req-6ee11f55-2716-4259-81d9-ae1741fb1d5b service nova] Releasing lock "refresh_cache-c9e9c604-3ed1-4162-b30e-629f34748c87" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:18:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-ebd1d412-d940-4cce-9506-d4fc333262e6 req-7ce3fda8-5c30-4e01-b930-e4db297e1ef7 service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Received event network-vif-plugged-f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ebd1d412-d940-4cce-9506-d4fc333262e6 req-7ce3fda8-5c30-4e01-b930-e4db297e1ef7 service nova] Acquiring lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ebd1d412-d940-4cce-9506-d4fc333262e6 req-7ce3fda8-5c30-4e01-b930-e4db297e1ef7 service nova] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ebd1d412-d940-4cce-9506-d4fc333262e6 req-7ce3fda8-5c30-4e01-b930-e4db297e1ef7 service nova] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-ebd1d412-d940-4cce-9506-d4fc333262e6 req-7ce3fda8-5c30-4e01-b930-e4db297e1ef7 service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] No waiting events found dispatching network-vif-plugged-f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:18:49 user nova-compute[75342]: WARNING nova.compute.manager [req-ebd1d412-d940-4cce-9506-d4fc333262e6 req-7ce3fda8-5c30-4e01-b930-e4db297e1ef7 service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Received unexpected event network-vif-plugged-f327819a-a3a9-4a62-af5b-93eb4581e280 for instance with vm_state building and task_state spawning.
Nov 16 18:18:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:18:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Instance spawned successfully.
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:18:51 user nova-compute[75342]: INFO nova.compute.manager [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-9cdb84cc-9903-415e-964b-25be53859275 req-c2017386-77ed-415b-a5ad-df63dcea1e3b service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Received event network-vif-plugged-f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9cdb84cc-9903-415e-964b-25be53859275 req-c2017386-77ed-415b-a5ad-df63dcea1e3b service nova] Acquiring lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9cdb84cc-9903-415e-964b-25be53859275 req-c2017386-77ed-415b-a5ad-df63dcea1e3b service nova] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9cdb84cc-9903-415e-964b-25be53859275 req-c2017386-77ed-415b-a5ad-df63dcea1e3b service nova] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-9cdb84cc-9903-415e-964b-25be53859275 req-c2017386-77ed-415b-a5ad-df63dcea1e3b service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] No waiting events found dispatching network-vif-plugged-f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:18:51 user nova-compute[75342]: WARNING nova.compute.manager [req-9cdb84cc-9903-415e-964b-25be53859275 req-c2017386-77ed-415b-a5ad-df63dcea1e3b service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Received unexpected event network-vif-plugged-f327819a-a3a9-4a62-af5b-93eb4581e280 for instance with vm_state building and task_state spawning.
Nov 16 18:18:51 user nova-compute[75342]: INFO nova.compute.manager [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Took 6.12 seconds to build instance.
Nov 16 18:18:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c986974c-11dc-4315-ad6e-d1753741501c tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.215s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:52 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:18:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:18:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:18:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:18:55 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:18:55 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8262MB free_disk=25.16867446899414GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 0c54066f-8fa7-4279-b62e-64614b01d6b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bd8e6fae-5355-449f-a552-e90f74d189d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c9e9c604-3ed1-4162-b30e-629f34748c87 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:18:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:18:57 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:18:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:02 user nova-compute[75342]: INFO nova.compute.manager [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Terminating instance
Nov 16 18:19:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-a901ee73-d905-4c23-a9a7-72645c52d7f4 req-5573fcc0-585d-43a3-854a-3ab299c4d723 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received event network-vif-unplugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a901ee73-d905-4c23-a9a7-72645c52d7f4 req-5573fcc0-585d-43a3-854a-3ab299c4d723 service nova] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a901ee73-d905-4c23-a9a7-72645c52d7f4 req-5573fcc0-585d-43a3-854a-3ab299c4d723 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a901ee73-d905-4c23-a9a7-72645c52d7f4 req-5573fcc0-585d-43a3-854a-3ab299c4d723 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-a901ee73-d905-4c23-a9a7-72645c52d7f4 req-5573fcc0-585d-43a3-854a-3ab299c4d723 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] No waiting events found dispatching network-vif-unplugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-a901ee73-d905-4c23-a9a7-72645c52d7f4 req-5573fcc0-585d-43a3-854a-3ab299c4d723 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received event network-vif-unplugged-804687ae-e749-44ee-ada3-856923763b9b for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:03 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Instance destroyed successfully.
Nov 16 18:19:03 user nova-compute[75342]: DEBUG nova.objects.instance [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'resources' on Instance uuid bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-133130086',display_name='tempest-ServerRescueNegativeTestJSON-server-133130086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-133130086',id=16,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:04:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-1niwqwea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:04:56Z,user_data=None,user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "804687ae-e749-44ee-ada3-856923763b9b", "address": "fa:16:3e:b9:0f:de", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804687ae-e7", "ovs_interfaceid": "804687ae-e749-44ee-ada3-856923763b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:0f:de,bridge_name='br-int',has_traffic_filtering=True,id=804687ae-e749-44ee-ada3-856923763b9b,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804687ae-e7') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG os_vif [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:0f:de,bridge_name='br-int',has_traffic_filtering=True,id=804687ae-e749-44ee-ada3-856923763b9b,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804687ae-e7') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap804687ae-e7, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=188363ec-6b54-4aa7-929b-8f5a219705ec) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:03 user nova-compute[75342]: INFO os_vif [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:0f:de,bridge_name='br-int',has_traffic_filtering=True,id=804687ae-e749-44ee-ada3-856923763b9b,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804687ae-e7')
Nov 16 18:19:03 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Deleting instance files /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f_del
Nov 16 18:19:03 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Deletion of /opt/stack/data/nova/instances/bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f_del complete
Nov 16 18:19:03 user nova-compute[75342]: INFO nova.compute.manager [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 16 18:19:03 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:19:03 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Took 0.45 seconds to deallocate network for instance.
Nov 16 18:19:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-d795b79f-32b4-4549-a0cf-5c1c5e6dd9d6 req-70227629-eb97-4d04-a784-fd8cafb7cace service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received event network-vif-deleted-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:19:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:04 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Deleted allocations for instance bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f
Nov 16 18:19:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a0ed5bd9-7db0-4e0a-b06d-76a202175027 tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.806s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-dd7b92dc-f2d9-40b9-9620-e2a2e1dc030e req-a5075bee-d921-464a-beaf-4d2816c31d72 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dd7b92dc-f2d9-40b9-9620-e2a2e1dc030e req-a5075bee-d921-464a-beaf-4d2816c31d72 service nova] Acquiring lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dd7b92dc-f2d9-40b9-9620-e2a2e1dc030e req-a5075bee-d921-464a-beaf-4d2816c31d72 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dd7b92dc-f2d9-40b9-9620-e2a2e1dc030e req-a5075bee-d921-464a-beaf-4d2816c31d72 service nova] Lock "bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-dd7b92dc-f2d9-40b9-9620-e2a2e1dc030e req-a5075bee-d921-464a-beaf-4d2816c31d72 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] No waiting events found dispatching network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:19:04 user nova-compute[75342]: WARNING nova.compute.manager [req-dd7b92dc-f2d9-40b9-9620-e2a2e1dc030e req-a5075bee-d921-464a-beaf-4d2816c31d72 service nova] [instance: bf0223e1-5d4d-4bdf-bb0d-ac294bd0c99f] Received unexpected event network-vif-plugged-804687ae-e749-44ee-ada3-856923763b9b for instance with vm_state deleted and task_state None.
Nov 16 18:19:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-c08fb0b9-4f31-4b98-88f1-4b602bababea req-ebe8334f-53e8-43f9-9997-cd933ed29ead service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Received event network-changed-8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-c08fb0b9-4f31-4b98-88f1-4b602bababea req-ebe8334f-53e8-43f9-9997-cd933ed29ead service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Refreshing instance network info cache due to event network-changed-8603ce17-5b31-4dda-8c75-8ff1e75675fc. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:19:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c08fb0b9-4f31-4b98-88f1-4b602bababea req-ebe8334f-53e8-43f9-9997-cd933ed29ead service nova] Acquiring lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:19:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c08fb0b9-4f31-4b98-88f1-4b602bababea req-ebe8334f-53e8-43f9-9997-cd933ed29ead service nova] Acquired lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:19:21 user nova-compute[75342]: DEBUG nova.network.neutron [req-c08fb0b9-4f31-4b98-88f1-4b602bababea req-ebe8334f-53e8-43f9-9997-cd933ed29ead service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Refreshing network info cache for port 8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:19:22 user nova-compute[75342]: DEBUG nova.network.neutron [req-c08fb0b9-4f31-4b98-88f1-4b602bababea req-ebe8334f-53e8-43f9-9997-cd933ed29ead service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Updated VIF entry in instance network info cache for port 8603ce17-5b31-4dda-8c75-8ff1e75675fc. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:19:22 user nova-compute[75342]: DEBUG nova.network.neutron [req-c08fb0b9-4f31-4b98-88f1-4b602bababea req-ebe8334f-53e8-43f9-9997-cd933ed29ead service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Updating instance_info_cache with network_info: [{"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:19:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c08fb0b9-4f31-4b98-88f1-4b602bababea req-ebe8334f-53e8-43f9-9997-cd933ed29ead service nova] Releasing lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:19:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-70794514-3e4b-47fe-9256-415afbc9febf req-40af4209-0a07-4976-a1dc-220d796d0692 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received event network-changed-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-70794514-3e4b-47fe-9256-415afbc9febf req-40af4209-0a07-4976-a1dc-220d796d0692 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Refreshing instance network info cache due to event network-changed-60e68362-04fe-4c9a-8c48-2d065c5b6fea. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:19:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-70794514-3e4b-47fe-9256-415afbc9febf req-40af4209-0a07-4976-a1dc-220d796d0692 service nova] Acquiring lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:19:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-70794514-3e4b-47fe-9256-415afbc9febf req-40af4209-0a07-4976-a1dc-220d796d0692 service nova] Acquired lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:19:22 user nova-compute[75342]: DEBUG nova.network.neutron [req-70794514-3e4b-47fe-9256-415afbc9febf req-40af4209-0a07-4976-a1dc-220d796d0692 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Refreshing network info cache for port 60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:23 user nova-compute[75342]: INFO nova.compute.manager [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Terminating instance
Nov 16 18:19:23 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG nova.network.neutron [req-70794514-3e4b-47fe-9256-415afbc9febf req-40af4209-0a07-4976-a1dc-220d796d0692 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Updated VIF entry in instance network info cache for port 60e68362-04fe-4c9a-8c48-2d065c5b6fea. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG nova.network.neutron [req-70794514-3e4b-47fe-9256-415afbc9febf req-40af4209-0a07-4976-a1dc-220d796d0692 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Updating instance_info_cache with network_info: [{"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-70794514-3e4b-47fe-9256-415afbc9febf req-40af4209-0a07-4976-a1dc-220d796d0692 service nova] Releasing lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:23 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Instance destroyed successfully.
Nov 16 18:19:23 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lazy-loading 'resources' on Instance uuid 0c54066f-8fa7-4279-b62e-64614b01d6b1 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T17:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1765059888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1765059888',id=3,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:00:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542bb854a1647618ba3995c4342109a',ramdisk_id='',reservation_id='r-0rom0ub2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-764398626',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:01:42Z,user_data=None,user_id='13beba5fa97a448fa863135a45e47cb9',uuid=0c54066f-8fa7-4279-b62e-64614b01d6b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converting VIF {"id": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "address": "fa:16:3e:cb:2f:77", "network": {"id": "360f4d42-eede-491d-853c-bc3653a1ba56", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-517040107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542bb854a1647618ba3995c4342109a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb89038-19", "ovs_interfaceid": "dfb89038-19a3-4873-83f9-a6dac7b334f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:2f:77,bridge_name='br-int',has_traffic_filtering=True,id=dfb89038-19a3-4873-83f9-a6dac7b334f9,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb89038-19') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG os_vif [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:2f:77,bridge_name='br-int',has_traffic_filtering=True,id=dfb89038-19a3-4873-83f9-a6dac7b334f9,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb89038-19') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfb89038-19, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0a28502-4135-44fd-9cc7-2301a25529cf) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:23 user nova-compute[75342]: INFO os_vif [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:2f:77,bridge_name='br-int',has_traffic_filtering=True,id=dfb89038-19a3-4873-83f9-a6dac7b334f9,network=Network(360f4d42-eede-491d-853c-bc3653a1ba56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb89038-19')
Nov 16 18:19:23 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Deleting instance files /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1_del
Nov 16 18:19:23 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Deletion of /opt/stack/data/nova/instances/0c54066f-8fa7-4279-b62e-64614b01d6b1_del complete
Nov 16 18:19:23 user nova-compute[75342]: INFO nova.compute.manager [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 18:19:23 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:19:23 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:19:24 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Took 0.45 seconds to deallocate network for instance.
Nov 16 18:19:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-bb3edb61-7768-4b8a-9caa-662bff16856b req-374e283a-1a11-4137-97db-6557412abaab service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Received event network-vif-deleted-dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 01d59cab-ff4e-4c62-92cc-50eca7089f6f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Received event network-vif-unplugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] Acquiring lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] No waiting events found dispatching network-vif-unplugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:19:24 user nova-compute[75342]: WARNING nova.compute.manager [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Received unexpected event network-vif-unplugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 for instance with vm_state deleted and task_state None.
Nov 16 18:19:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Received event network-vif-plugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] Acquiring lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] No waiting events found dispatching network-vif-plugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:19:24 user nova-compute[75342]: WARNING nova.compute.manager [req-71862fd5-b183-4140-aa41-562c0afc39e5 req-16a0bd6e-3c17-477c-b2c5-ec34f8ed3461 service nova] [instance: 0c54066f-8fa7-4279-b62e-64614b01d6b1] Received unexpected event network-vif-plugged-dfb89038-19a3-4873-83f9-a6dac7b334f9 for instance with vm_state deleted and task_state None.
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:24 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Deleted allocations for instance 0c54066f-8fa7-4279-b62e-64614b01d6b1
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1be2b0ae-70f8-4bd1-96d9-19e2a392b844 tempest-ServerBootFromVolumeStableRescueTest-764398626 tempest-ServerBootFromVolumeStableRescueTest-764398626-project-member] Lock "0c54066f-8fa7-4279-b62e-64614b01d6b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:24 user nova-compute[75342]: INFO nova.compute.manager [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Attaching volume 1e769e6c-61d0-4a59-8c38-136d6d260431 to /dev/vdb
Nov 16 18:19:25 user nova-compute[75342]: DEBUG os_brick.utils [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[77701a4f-f6a2-42a6-9fad-a8df207a2a4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5523130-b6b7-405a-890c-1e8bfad09efb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efdff36-5169-49ad-b282-4bfd75acb8ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[750de8da-83f4-4371-b195-97881f332c4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:19:25 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:19:25 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdd713a-8f0c-4dd7-b1b3-9f62b645b692]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG os_brick.utils [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:19:25 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Updating existing volume attachment record: a65842af-0b69-4bac-93c0-31cc6770981c {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "08da7bca-b538-4c74-8bbf-a55268c1c84c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:19:28 user nova-compute[75342]: INFO nova.compute.claims [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Claim successful on node user
Nov 16 18:19:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:19:28 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:19:28 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:19:29 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG nova.policy [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '062cd6d338014493be6c40701d2a735b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d44dce2b444ef386b47927d5c70c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:19:29 user nova-compute[75342]: INFO nova.virt.block_device [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Booting with volume a6c1584b-fc42-4619-afe0-78c5cc22bd4c at /dev/vda
Nov 16 18:19:29 user nova-compute[75342]: DEBUG os_brick.utils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f2def0-b03b-4825-9890-aee2ed9550ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d51f21-d0d3-4ba0-8933-f4f4aa24ac34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17b2c6c-2469-47a2-ba5d-bf0c12286a7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[613ff23a-a88a-48cf-8316-37037b967fcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:19:29 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a032b0e4-0f18-4e5d-bf60-30eab4d5d7e5]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG os_brick.utils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Updating existing volume attachment record: b9982571-2254-4cfb-bcf7-22dcc32e7e0e {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Successfully created port: e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSwYrIlt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:19:29 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:19:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:19:29 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:19:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:19:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:19:29 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:19:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9879c9c-0112-45f3-8df0-48e5912ecbe3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:19:30 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ed5e01-ac4f-415d-985c-ae13aef2c523]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431] added
Nov 16 18:19:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ec1f89-6ad3-4ba4-8bd5-34d2a77cc205]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca5db1c-4266-49b3-964e-97ba3e52e72f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSwYrIlt {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSwYrIlt" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb77122-7891-4ace-9dd1-845daeaf80e6]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pSwYrIlt'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34de53e-cbf5-413d-9835-2c8664d25d3e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21f2841-332e-45e3-91c4-0a5c3270052a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e842d2d4-c8d7-4e42-80c8-641acce5a674]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431, portal: 172.16.0.220,3260]
Nov 16 18:19:30 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431, portal: 172.16.0.220,3260] successful.
Nov 16 18:19:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18068a5-c8ed-43ce-be1a-eb8000e1f727]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4c47c3-3311-471b-9bf7-d45ebadc2028]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:30 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:19:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:30 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:19:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0613ac43-bae5-477e-80f1-3bcf3f058ee9]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSwYrIlt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Successfully updated port: e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquired lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-68e9bab7-5ef6-47f9-9b6f-7c43f4523e3a req-b60d06df-ae25-435d-a727-3e52fe506837 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received event network-changed-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-68e9bab7-5ef6-47f9-9b6f-7c43f4523e3a req-b60d06df-ae25-435d-a727-3e52fe506837 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Refreshing instance network info cache due to event network-changed-e45d55f9-5951-469c-ae64-9d35dd755b37. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-68e9bab7-5ef6-47f9-9b6f-7c43f4523e3a req-b60d06df-ae25-435d-a727-3e52fe506837 service nova] Acquiring lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:19:30 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG nova.network.neutron [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Updating instance_info_cache with network_info: [{"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Releasing lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Instance network_info: |[{"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-68e9bab7-5ef6-47f9-9b6f-7c43f4523e3a req-b60d06df-ae25-435d-a727-3e52fe506837 service nova] Acquired lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG nova.network.neutron [req-68e9bab7-5ef6-47f9-9b6f-7c43f4523e3a req-b60d06df-ae25-435d-a727-3e52fe506837 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Refreshing network info cache for port e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23033383531343265', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033383531343265', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 01d59cab-ff4e-4c62-92cc-50eca7089f6f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:19:31 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:19:31 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:19:31 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:19:31 user nova-compute[75342]:   <serial>1e769e6c-61d0-4a59-8c38-136d6d260431</serial>
Nov 16 18:19:31 user nova-compute[75342]: </disk>
Nov 16 18:19:31 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG nova.network.neutron [req-68e9bab7-5ef6-47f9-9b6f-7c43f4523e3a req-b60d06df-ae25-435d-a727-3e52fe506837 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Updated VIF entry in instance network info cache for port e45d55f9-5951-469c-ae64-9d35dd755b37. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG nova.network.neutron [req-68e9bab7-5ef6-47f9-9b6f-7c43f4523e3a req-b60d06df-ae25-435d-a727-3e52fe506837 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Updating instance_info_cache with network_info: [{"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-68e9bab7-5ef6-47f9-9b6f-7c43f4523e3a req-b60d06df-ae25-435d-a727-3e52fe506837 service nova] Releasing lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No VIF found with MAC fa:16:3e:d6:a5:e7, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:19:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f60b5763-4a7d-4514-b51f-efb444a39dbc tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.925s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 01d59cab-ff4e-4c62-92cc-50eca7089f6f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:34 user nova-compute[75342]: INFO nova.compute.manager [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Attaching volume 16c17861-91b0-4de7-89dc-6e05a9b9af53 to /dev/vdc
Nov 16 18:19:34 user nova-compute[75342]: DEBUG os_brick.utils [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f726f93d-d821-41ee-9575-df6cf4710a40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb6a193-d10f-42ff-bbdb-ba53978b553a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ff9dc8-4d7a-4e95-b472-f91dc5760fc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e0e290-e7fe-4fa1-9b40-e0431fff2cfe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:19:34 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Creating image(s)
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Did not create local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Ensure instance console log exists: /opt/stack/data/nova/instances/08da7bca-b538-4c74-8bbf-a55268c1c84c/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Start _get_guest_xml network_info=[{"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b9982571-2254-4cfb-bcf7-22dcc32e7e0e', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arJlgwen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '08da7bca-b538-4c74-8bbf-a55268c1c84c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6c1584b-fc42-4619-afe0-78c5cc22bd4c', 'serial': 'a6c1584b-fc42-4619-afe0-78c5cc22bd4c'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:19:34 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2f71ba-2813-4dd3-acd8-296c337f6f5b]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG os_brick.utils [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Updating existing volume attachment record: c4b55026-0f20-480f-a053-eb110bb6a130 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:19:34 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:19:34 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arJlgwen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:19:34 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:19:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:19:34 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:19:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:19:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:19:34 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:19:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb1995e-e94b-4a8a-8f51-b9a1536d3606]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:19:35 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e44406-11d1-4ec2-bba6-fb9769637a41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c] added
Nov 16 18:19:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2f0293-04e3-430b-ab5b-57688f833e0a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f37ffc4-bba3-4a0f-8d9d-fa7015f1507b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arJlgwen {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arJlgwen" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[327fb1d7-3e99-4d2a-8c6c-50d398597c15]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'arJlgwen'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e87609a-b9c7-4501-acaf-a2b1af949492]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14ad3a2-3465-4168-ba24-424436bf16a7]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:35 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:19:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:35 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:19:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad83d2cf-912f-4065-8fea-37b910c8da12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c, portal: 172.16.0.220,3260]
Nov 16 18:19:35 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c, portal: 172.16.0.220,3260] successful.
Nov 16 18:19:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[75989b39-1804-477f-afeb-522956679326]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c96cf0-9d80-440c-90d8-6bcaf2960139]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:35 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:19:35 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:19:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:35 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:19:35 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:19:35 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[070bd957-7de9-46bb-a0b3-294ccd59b062]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:19:35 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arJlgwen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26163373232656462', 'path': '/dev/sdd'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163373232656462', 'path': '/dev/sdd'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:19:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-133675700',display_name='tempest-TestVolumeBootPattern-server-133675700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-133675700',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxsC14B7FXvV2fSoMtlJDAqdPeFWveN/Z0Ifom/f6iLWm22eKeX4OVWWNojR/qqP5b5ZDw4QQNhLxzsgEQuPgfcqpGQNglCOOs11ACZVIFU1+eY4bhyAYc4WrWEkoqGQ==',key_name='tempest-TestVolumeBootPattern-2105905581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-41jderxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:19:29Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=08da7bca-b538-4c74-8bbf-a55268c1c84c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=e45d55f9-5951-469c-ae64-9d35dd755b37,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45d55f9-59') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'pci_devices' on Instance uuid 08da7bca-b538-4c74-8bbf-a55268c1c84c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:19:36 user nova-compute[75342]:   <uuid>08da7bca-b538-4c74-8bbf-a55268c1c84c</uuid>
Nov 16 18:19:36 user nova-compute[75342]:   <name>instance-00000028</name>
Nov 16 18:19:36 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:19:36 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:19:36 user nova-compute[75342]:   <metadata>
Nov 16 18:19:36 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:19:36 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:19:36 user nova-compute[75342]:       <nova:name>tempest-TestVolumeBootPattern-server-133675700</nova:name>
Nov 16 18:19:36 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:19:34</nova:creationTime>
Nov 16 18:19:36 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:19:36 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:19:36 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:19:36 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:19:36 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:19:36 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:19:36 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:19:36 user nova-compute[75342]:       <nova:owner>
Nov 16 18:19:36 user nova-compute[75342]:         <nova:user uuid="062cd6d338014493be6c40701d2a735b">tempest-TestVolumeBootPattern-312873750-project-member</nova:user>
Nov 16 18:19:36 user nova-compute[75342]:         <nova:project uuid="46d44dce2b444ef386b47927d5c70c8e">tempest-TestVolumeBootPattern-312873750</nova:project>
Nov 16 18:19:36 user nova-compute[75342]:       </nova:owner>
Nov 16 18:19:36 user nova-compute[75342]:       <nova:ports>
Nov 16 18:19:36 user nova-compute[75342]:         <nova:port uuid="e45d55f9-5951-469c-ae64-9d35dd755b37">
Nov 16 18:19:36 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 18:19:36 user nova-compute[75342]:         </nova:port>
Nov 16 18:19:36 user nova-compute[75342]:       </nova:ports>
Nov 16 18:19:36 user nova-compute[75342]:     </nova:instance>
Nov 16 18:19:36 user nova-compute[75342]:   </metadata>
Nov 16 18:19:36 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:19:36 user nova-compute[75342]:     <system>
Nov 16 18:19:36 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:19:36 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:19:36 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:19:36 user nova-compute[75342]:       <entry name="serial">08da7bca-b538-4c74-8bbf-a55268c1c84c</entry>
Nov 16 18:19:36 user nova-compute[75342]:       <entry name="uuid">08da7bca-b538-4c74-8bbf-a55268c1c84c</entry>
Nov 16 18:19:36 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:19:36 user nova-compute[75342]:     </system>
Nov 16 18:19:36 user nova-compute[75342]:   </sysinfo>
Nov 16 18:19:36 user nova-compute[75342]:   <os>
Nov 16 18:19:36 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:19:36 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:19:36 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:19:36 user nova-compute[75342]:   </os>
Nov 16 18:19:36 user nova-compute[75342]:   <features>
Nov 16 18:19:36 user nova-compute[75342]:     <acpi/>
Nov 16 18:19:36 user nova-compute[75342]:     <apic/>
Nov 16 18:19:36 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:19:36 user nova-compute[75342]:   </features>
Nov 16 18:19:36 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:19:36 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:19:36 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:19:36 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:19:36 user nova-compute[75342]:   </clock>
Nov 16 18:19:36 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:19:36 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:19:36 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:19:36 user nova-compute[75342]:   </cpu>
Nov 16 18:19:36 user nova-compute[75342]:   <devices>
Nov 16 18:19:36 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:19:36 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:19:36 user nova-compute[75342]:       <source dev="/dev/sdd"/>
Nov 16 18:19:36 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:19:36 user nova-compute[75342]:       <serial>a6c1584b-fc42-4619-afe0-78c5cc22bd4c</serial>
Nov 16 18:19:36 user nova-compute[75342]:     </disk>
Nov 16 18:19:36 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:19:36 user nova-compute[75342]:       <mac address="fa:16:3e:4e:f3:10"/>
Nov 16 18:19:36 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:19:36 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:19:36 user nova-compute[75342]:       <target dev="tape45d55f9-59"/>
Nov 16 18:19:36 user nova-compute[75342]:     </interface>
Nov 16 18:19:36 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:19:36 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/08da7bca-b538-4c74-8bbf-a55268c1c84c/console.log" append="off"/>
Nov 16 18:19:36 user nova-compute[75342]:     </serial>
Nov 16 18:19:36 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:19:36 user nova-compute[75342]:     <video>
Nov 16 18:19:36 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:19:36 user nova-compute[75342]:     </video>
Nov 16 18:19:36 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:19:36 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:19:36 user nova-compute[75342]:     </rng>
Nov 16 18:19:36 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:19:36 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:19:36 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:19:36 user nova-compute[75342]:     </memballoon>
Nov 16 18:19:36 user nova-compute[75342]:   </devices>
Nov 16 18:19:36 user nova-compute[75342]: </domain>
Nov 16 18:19:36 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:19:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-133675700',display_name='tempest-TestVolumeBootPattern-server-133675700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-133675700',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxsC14B7FXvV2fSoMtlJDAqdPeFWveN/Z0Ifom/f6iLWm22eKeX4OVWWNojR/qqP5b5ZDw4QQNhLxzsgEQuPgfcqpGQNglCOOs11ACZVIFU1+eY4bhyAYc4WrWEkoqGQ==',key_name='tempest-TestVolumeBootPattern-2105905581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-41jderxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:19:29Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=08da7bca-b538-4c74-8bbf-a55268c1c84c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=e45d55f9-5951-469c-ae64-9d35dd755b37,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45d55f9-59') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG os_vif [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=e45d55f9-5951-469c-ae64-9d35dd755b37,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45d55f9-59') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e677d2d-b35c-57db-843f-b60e13ba4878', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape45d55f9-59, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape45d55f9-59, col_values=(('qos', UUID('85a97067-bc7b-4c4a-be29-fe8b57cd0038')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape45d55f9-59, col_values=(('external_ids', {'iface-id': 'e45d55f9-5951-469c-ae64-9d35dd755b37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:f3:10', 'vm-uuid': '08da7bca-b538-4c74-8bbf-a55268c1c84c'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:36 user nova-compute[75342]: INFO os_vif [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=e45d55f9-5951-469c-ae64-9d35dd755b37,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45d55f9-59')
Nov 16 18:19:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:19:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] No VIF found with MAC fa:16:3e:4e:f3:10, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:19:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-5efe05f2-e1f3-4a2e-80f4-22d18a30d084 req-19e4b48f-fa03-49a3-9241-51229eefdfb0 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received event network-vif-plugged-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5efe05f2-e1f3-4a2e-80f4-22d18a30d084 req-19e4b48f-fa03-49a3-9241-51229eefdfb0 service nova] Acquiring lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5efe05f2-e1f3-4a2e-80f4-22d18a30d084 req-19e4b48f-fa03-49a3-9241-51229eefdfb0 service nova] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5efe05f2-e1f3-4a2e-80f4-22d18a30d084 req-19e4b48f-fa03-49a3-9241-51229eefdfb0 service nova] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:38 user nova-compute[75342]: DEBUG nova.compute.manager [req-5efe05f2-e1f3-4a2e-80f4-22d18a30d084 req-19e4b48f-fa03-49a3-9241-51229eefdfb0 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] No waiting events found dispatching network-vif-plugged-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:19:38 user nova-compute[75342]: WARNING nova.compute.manager [req-5efe05f2-e1f3-4a2e-80f4-22d18a30d084 req-19e4b48f-fa03-49a3-9241-51229eefdfb0 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received unexpected event network-vif-plugged-e45d55f9-5951-469c-ae64-9d35dd755b37 for instance with vm_state building and task_state spawning.
Nov 16 18:19:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:39 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:19:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:19:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Instance spawned successfully.
Nov 16 18:19:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:19:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:40 user nova-compute[75342]: INFO nova.compute.manager [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 16 18:19:40 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:19:40 user nova-compute[75342]: INFO nova.compute.manager [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Took 11.55 seconds to build instance.
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c8fc5d3-7805-473c-932f-a561dfb9a87c tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.680s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG nova.compute.manager [req-17da5e94-3c63-47c3-ba70-1ffa3904d1cc req-adb5a108-449c-4cd9-b8dd-7c9d1227ddbf service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received event network-vif-plugged-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17da5e94-3c63-47c3-ba70-1ffa3904d1cc req-adb5a108-449c-4cd9-b8dd-7c9d1227ddbf service nova] Acquiring lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17da5e94-3c63-47c3-ba70-1ffa3904d1cc req-adb5a108-449c-4cd9-b8dd-7c9d1227ddbf service nova] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17da5e94-3c63-47c3-ba70-1ffa3904d1cc req-adb5a108-449c-4cd9-b8dd-7c9d1227ddbf service nova] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG nova.compute.manager [req-17da5e94-3c63-47c3-ba70-1ffa3904d1cc req-adb5a108-449c-4cd9-b8dd-7c9d1227ddbf service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] No waiting events found dispatching network-vif-plugged-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:19:40 user nova-compute[75342]: WARNING nova.compute.manager [req-17da5e94-3c63-47c3-ba70-1ffa3904d1cc req-adb5a108-449c-4cd9-b8dd-7c9d1227ddbf service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received unexpected event network-vif-plugged-e45d55f9-5951-469c-ae64-9d35dd755b37 for instance with vm_state active and task_state None.
Nov 16 18:19:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALluBrSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:19:40 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:19:40 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:19:40 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[faea1d0f-3f40-4282-90a6-fe11f015bf56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:19:40 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4135a5d-27d4-4859-a0e8-f7ae18e09eba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53] added
Nov 16 18:19:40 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4555d595-978f-440a-bc36-e479158a7590]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fc0f72-6285-47bd-9440-c2deaf47f763]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALluBrSd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALluBrSd" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeaa097-32e9-4872-8c98-0f288ed8404b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ALluBrSd'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e958a3-3d12-4dec-afd3-6aeea0effc90]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f1e65-88c9-4ae3-9e8f-cf602f3fd787]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:40 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:19:40 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:19:40 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:40 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:19:40 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:19:40 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a713e9bd-10f4-435f-b77c-a959f45b6aa9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53, portal: 172.16.0.220,3260]
Nov 16 18:19:40 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53, portal: 172.16.0.220,3260] successful.
Nov 16 18:19:40 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b20f7c8-2471-4272-b7fa-0825bcb1197b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaae028-7bd2-4b5e-8eb4-0f49d8d3aa6f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:40 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:19:40 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:19:40 user nova-compute[75342]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 (non-flash)
Nov 16 18:19:40 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:19:40 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:19:40 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:19:40 user nova-compute[75342]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 (non-flash)
Nov 16 18:19:40 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.047s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4807e3f9-5260-4b8c-a25a-51d12bcf0fbb]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:19:40 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALluBrSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:19:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:19:41 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26464356463626233', 'path': '/dev/sde'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:19:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464356463626233', 'path': '/dev/sde'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:19:41 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 01d59cab-ff4e-4c62-92cc-50eca7089f6f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:19:41 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:19:41 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:19:41 user nova-compute[75342]:   <source dev="/dev/sde"/>
Nov 16 18:19:41 user nova-compute[75342]:   <target dev="vdc" bus="virtio"/>
Nov 16 18:19:41 user nova-compute[75342]:   <serial>16c17861-91b0-4de7-89dc-6e05a9b9af53</serial>
Nov 16 18:19:41 user nova-compute[75342]: </disk>
Nov 16 18:19:41 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] No VIF found with MAC fa:16:3e:d6:a5:e7, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3c38544b-5b6b-4ed5-919d-1ea073cfc7a8 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.493s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:42 user nova-compute[75342]: INFO nova.compute.manager [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Detaching volume 1e769e6c-61d0-4a59-8c38-136d6d260431
Nov 16 18:19:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:19:42 user nova-compute[75342]: INFO nova.compute.claims [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Claim successful on node user
Nov 16 18:19:42 user nova-compute[75342]: INFO nova.virt.block_device [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Attempting to driver detach volume 1e769e6c-61d0-4a59-8c38-136d6d260431 from mountpoint /dev/vdb
Nov 16 18:19:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Attempting to detach device vdb from instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:19:42 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:19:42 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:19:42 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:19:42 user nova-compute[75342]:   <serial>1e769e6c-61d0-4a59-8c38-136d6d260431</serial>
Nov 16 18:19:42 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:19:42 user nova-compute[75342]: </disk>
Nov 16 18:19:42 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:19:42 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully detached device vdb from instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f from the persistent domain config.
Nov 16 18:19:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:19:42 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:19:42 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:19:42 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:19:42 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:19:42 user nova-compute[75342]:   <serial>1e769e6c-61d0-4a59-8c38-136d6d260431</serial>
Nov 16 18:19:42 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:19:42 user nova-compute[75342]: </disk>
Nov 16 18:19:42 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:19:43 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:19:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG nova.policy [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36644656ce1f4f2e8a440d625a7285b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385c90950e3c4c7fbdcd36d6d9062685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:19:43 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Creating image(s)
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "/opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "/opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "/opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk 1073741824" returned: 0 in 0.054s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:43 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Successfully created port: e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Cannot resize image /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Ensure instance console log exists: /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Successfully updated port: e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquired lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-563e810c-3e61-4ed5-92a3-cab818e395c8 req-3da185ab-2269-4e15-aa02-b8996f738096 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-changed-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.compute.manager [req-563e810c-3e61-4ed5-92a3-cab818e395c8 req-3da185ab-2269-4e15-aa02-b8996f738096 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Refreshing instance network info cache due to event network-changed-e421c3fa-c93c-486e-9658-a24ae8089927. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-563e810c-3e61-4ed5-92a3-cab818e395c8 req-3da185ab-2269-4e15-aa02-b8996f738096 service nova] Acquiring lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.network.neutron [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updating instance_info_cache with network_info: [{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Releasing lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Instance network_info: |[{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-563e810c-3e61-4ed5-92a3-cab818e395c8 req-3da185ab-2269-4e15-aa02-b8996f738096 service nova] Acquired lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.network.neutron [req-563e810c-3e61-4ed5-92a3-cab818e395c8 req-3da185ab-2269-4e15-aa02-b8996f738096 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Refreshing network info cache for port e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Start _get_guest_xml network_info=[{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:19:44 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:19:44 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-314776098',display_name='tempest-ServerStableDeviceRescueTest-server-314776098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-314776098',id=41,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7slAhf1hcJjJc66r2jbRftcH0SKdrSI9SpP1eFgrtS94QNgsdg+iL6y93giftSWmkKIikiQ6vcEwKshKM/mm1C/N/UhH6LgQdD1fQLE7/00l44zE3dmSxSyV3Y4Zgtmg==',key_name='tempest-keypair-609421127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='385c90950e3c4c7fbdcd36d6d9062685',ramdisk_id='',reservation_id='r-a7m9xowp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1240631636',owner_user_name='tempest-ServerStableDeviceRescueTest-1240631636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36644656ce1f4f2e8a440d625a7285b3',uuid=5edd2a74-89b9-4163-b452-d491be30059b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Converting VIF {"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b2:a7,bridge_name='br-int',has_traffic_filtering=True,id=e421c3fa-c93c-486e-9658-a24ae8089927,network=Network(aad7e3f8-f970-4c25-b0f1-df64acead2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape421c3fa-c9') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'pci_devices' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:19:44 user nova-compute[75342]:   <uuid>5edd2a74-89b9-4163-b452-d491be30059b</uuid>
Nov 16 18:19:44 user nova-compute[75342]:   <name>instance-00000029</name>
Nov 16 18:19:44 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:19:44 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:19:44 user nova-compute[75342]:   <metadata>
Nov 16 18:19:44 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:19:44 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:19:44 user nova-compute[75342]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-314776098</nova:name>
Nov 16 18:19:44 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:19:44</nova:creationTime>
Nov 16 18:19:44 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:19:44 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:19:44 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:19:44 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:19:44 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:19:44 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:19:44 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:19:44 user nova-compute[75342]:       <nova:owner>
Nov 16 18:19:44 user nova-compute[75342]:         <nova:user uuid="36644656ce1f4f2e8a440d625a7285b3">tempest-ServerStableDeviceRescueTest-1240631636-project-member</nova:user>
Nov 16 18:19:44 user nova-compute[75342]:         <nova:project uuid="385c90950e3c4c7fbdcd36d6d9062685">tempest-ServerStableDeviceRescueTest-1240631636</nova:project>
Nov 16 18:19:44 user nova-compute[75342]:       </nova:owner>
Nov 16 18:19:44 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:19:44 user nova-compute[75342]:       <nova:ports>
Nov 16 18:19:44 user nova-compute[75342]:         <nova:port uuid="e421c3fa-c93c-486e-9658-a24ae8089927">
Nov 16 18:19:44 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 18:19:44 user nova-compute[75342]:         </nova:port>
Nov 16 18:19:44 user nova-compute[75342]:       </nova:ports>
Nov 16 18:19:44 user nova-compute[75342]:     </nova:instance>
Nov 16 18:19:44 user nova-compute[75342]:   </metadata>
Nov 16 18:19:44 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:19:44 user nova-compute[75342]:     <system>
Nov 16 18:19:44 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:19:44 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:19:44 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:19:44 user nova-compute[75342]:       <entry name="serial">5edd2a74-89b9-4163-b452-d491be30059b</entry>
Nov 16 18:19:44 user nova-compute[75342]:       <entry name="uuid">5edd2a74-89b9-4163-b452-d491be30059b</entry>
Nov 16 18:19:44 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:19:44 user nova-compute[75342]:     </system>
Nov 16 18:19:44 user nova-compute[75342]:   </sysinfo>
Nov 16 18:19:44 user nova-compute[75342]:   <os>
Nov 16 18:19:44 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:19:44 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:19:44 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:19:44 user nova-compute[75342]:   </os>
Nov 16 18:19:44 user nova-compute[75342]:   <features>
Nov 16 18:19:44 user nova-compute[75342]:     <acpi/>
Nov 16 18:19:44 user nova-compute[75342]:     <apic/>
Nov 16 18:19:44 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:19:44 user nova-compute[75342]:   </features>
Nov 16 18:19:44 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:19:44 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:19:44 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:19:44 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:19:44 user nova-compute[75342]:   </clock>
Nov 16 18:19:44 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:19:44 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:19:44 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:19:44 user nova-compute[75342]:   </cpu>
Nov 16 18:19:44 user nova-compute[75342]:   <devices>
Nov 16 18:19:44 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:19:44 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:19:44 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk"/>
Nov 16 18:19:44 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:19:44 user nova-compute[75342]:     </disk>
Nov 16 18:19:44 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:19:44 user nova-compute[75342]:       <mac address="fa:16:3e:4e:b2:a7"/>
Nov 16 18:19:44 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:19:44 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:19:44 user nova-compute[75342]:       <target dev="tape421c3fa-c9"/>
Nov 16 18:19:44 user nova-compute[75342]:     </interface>
Nov 16 18:19:44 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:19:44 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/console.log" append="off"/>
Nov 16 18:19:44 user nova-compute[75342]:     </serial>
Nov 16 18:19:44 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:19:44 user nova-compute[75342]:     <video>
Nov 16 18:19:44 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:19:44 user nova-compute[75342]:     </video>
Nov 16 18:19:44 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:19:44 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:19:44 user nova-compute[75342]:     </rng>
Nov 16 18:19:44 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:19:44 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:19:44 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:19:44 user nova-compute[75342]:     </memballoon>
Nov 16 18:19:44 user nova-compute[75342]:   </devices>
Nov 16 18:19:44 user nova-compute[75342]: </domain>
Nov 16 18:19:44 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-314776098',display_name='tempest-ServerStableDeviceRescueTest-server-314776098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-314776098',id=41,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7slAhf1hcJjJc66r2jbRftcH0SKdrSI9SpP1eFgrtS94QNgsdg+iL6y93giftSWmkKIikiQ6vcEwKshKM/mm1C/N/UhH6LgQdD1fQLE7/00l44zE3dmSxSyV3Y4Zgtmg==',key_name='tempest-keypair-609421127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='385c90950e3c4c7fbdcd36d6d9062685',ramdisk_id='',reservation_id='r-a7m9xowp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1240631636',owner_user_name='tempest-ServerStableDeviceRescueTest-1240631636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36644656ce1f4f2e8a440d625a7285b3',uuid=5edd2a74-89b9-4163-b452-d491be30059b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Converting VIF {"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b2:a7,bridge_name='br-int',has_traffic_filtering=True,id=e421c3fa-c93c-486e-9658-a24ae8089927,network=Network(aad7e3f8-f970-4c25-b0f1-df64acead2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape421c3fa-c9') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG os_vif [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b2:a7,bridge_name='br-int',has_traffic_filtering=True,id=e421c3fa-c93c-486e-9658-a24ae8089927,network=Network(aad7e3f8-f970-4c25-b0f1-df64acead2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape421c3fa-c9') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89944a66-c0d5-54e7-b3ec-432d2d03cc74', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:19:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape421c3fa-c9, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape421c3fa-c9, col_values=(('qos', UUID('640d3425-fecd-4ed5-b311-2ba4340ad6ca')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape421c3fa-c9, col_values=(('external_ids', {'iface-id': 'e421c3fa-c93c-486e-9658-a24ae8089927', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:b2:a7', 'vm-uuid': '5edd2a74-89b9-4163-b452-d491be30059b'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:19:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:45 user nova-compute[75342]: INFO os_vif [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b2:a7,bridge_name='br-int',has_traffic_filtering=True,id=e421c3fa-c93c-486e-9658-a24ae8089927,network=Network(aad7e3f8-f970-4c25-b0f1-df64acead2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape421c3fa-c9')
Nov 16 18:19:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:19:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] No VIF found with MAC fa:16:3e:4e:b2:a7, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:19:45 user nova-compute[75342]: DEBUG nova.network.neutron [req-563e810c-3e61-4ed5-92a3-cab818e395c8 req-3da185ab-2269-4e15-aa02-b8996f738096 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updated VIF entry in instance network info cache for port e421c3fa-c93c-486e-9658-a24ae8089927. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:19:45 user nova-compute[75342]: DEBUG nova.network.neutron [req-563e810c-3e61-4ed5-92a3-cab818e395c8 req-3da185ab-2269-4e15-aa02-b8996f738096 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updating instance_info_cache with network_info: [{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:19:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-563e810c-3e61-4ed5-92a3-cab818e395c8 req-3da185ab-2269-4e15-aa02-b8996f738096 service nova] Releasing lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-a8fcd933-cd9f-4b2d-80db-7add21291f0c req-8d43ef89-e3d7-4228-9a3a-f0cc7b8fa803 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a8fcd933-cd9f-4b2d-80db-7add21291f0c req-8d43ef89-e3d7-4228-9a3a-f0cc7b8fa803 service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a8fcd933-cd9f-4b2d-80db-7add21291f0c req-8d43ef89-e3d7-4228-9a3a-f0cc7b8fa803 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a8fcd933-cd9f-4b2d-80db-7add21291f0c req-8d43ef89-e3d7-4228-9a3a-f0cc7b8fa803 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-a8fcd933-cd9f-4b2d-80db-7add21291f0c req-8d43ef89-e3d7-4228-9a3a-f0cc7b8fa803 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:19:46 user nova-compute[75342]: WARNING nova.compute.manager [req-a8fcd933-cd9f-4b2d-80db-7add21291f0c req-8d43ef89-e3d7-4228-9a3a-f0cc7b8fa803 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received unexpected event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with vm_state building and task_state spawning.
Nov 16 18:19:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:19:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:19:48 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Instance spawned successfully.
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:19:48 user nova-compute[75342]: INFO nova.compute.manager [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-17085f15-1347-467f-bfeb-af466d974be0 req-2db2530f-759a-4b4b-a2e9-863ba7776c5d service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17085f15-1347-467f-bfeb-af466d974be0 req-2db2530f-759a-4b4b-a2e9-863ba7776c5d service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17085f15-1347-467f-bfeb-af466d974be0 req-2db2530f-759a-4b4b-a2e9-863ba7776c5d service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-17085f15-1347-467f-bfeb-af466d974be0 req-2db2530f-759a-4b4b-a2e9-863ba7776c5d service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-17085f15-1347-467f-bfeb-af466d974be0 req-2db2530f-759a-4b4b-a2e9-863ba7776c5d service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:19:48 user nova-compute[75342]: WARNING nova.compute.manager [req-17085f15-1347-467f-bfeb-af466d974be0 req-2db2530f-759a-4b4b-a2e9-863ba7776c5d service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received unexpected event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with vm_state building and task_state spawning.
Nov 16 18:19:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:48 user nova-compute[75342]: INFO nova.compute.manager [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Took 5.87 seconds to build instance.
Nov 16 18:19:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9a8f6ee2-0690-4d41-901c-f3b76deac469 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.972s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:52 user nova-compute[75342]: INFO nova.compute.manager [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Terminating instance
Nov 16 18:19:52 user nova-compute[75342]: DEBUG nova.compute.manager [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-6f06ff6d-5dce-4447-b70f-779becadae9f req-b658e712-1312-4abd-901c-045efe2f1b48 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-unplugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6f06ff6d-5dce-4447-b70f-779becadae9f req-b658e712-1312-4abd-901c-045efe2f1b48 service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6f06ff6d-5dce-4447-b70f-779becadae9f req-b658e712-1312-4abd-901c-045efe2f1b48 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6f06ff6d-5dce-4447-b70f-779becadae9f req-b658e712-1312-4abd-901c-045efe2f1b48 service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-6f06ff6d-5dce-4447-b70f-779becadae9f req-b658e712-1312-4abd-901c-045efe2f1b48 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-unplugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-6f06ff6d-5dce-4447-b70f-779becadae9f req-b658e712-1312-4abd-901c-045efe2f1b48 service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-unplugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:53 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Instance destroyed successfully.
Nov 16 18:19:53 user nova-compute[75342]: DEBUG nova.objects.instance [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lazy-loading 'resources' on Instance uuid d0385123-12ff-41a3-a78d-ac5ce325ae0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1931076852',display_name='tempest-ServerRescueNegativeTestJSON-server-1931076852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1931076852',id=15,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:07:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02d87f343b6e4dbead83e037619ae49c',ramdisk_id='',reservation_id='r-aaovrqtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-935902109',owner_user_name='tempest-ServerRescueNegativeTestJSON-935902109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:09:40Z,user_data=None,user_id='0697a15cd0054cef90459da99a3fd8ec',uuid=d0385123-12ff-41a3-a78d-ac5ce325ae0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converting VIF {"id": "5790346b-5f12-43ca-8348-7401eff36734", "address": "fa:16:3e:f5:53:c1", "network": {"id": "b834cf36-0c9f-4e46-a91c-dda85f95337b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-484010712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02d87f343b6e4dbead83e037619ae49c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5790346b-5f", "ovs_interfaceid": "5790346b-5f12-43ca-8348-7401eff36734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:53:c1,bridge_name='br-int',has_traffic_filtering=True,id=5790346b-5f12-43ca-8348-7401eff36734,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5790346b-5f') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG os_vif [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:53:c1,bridge_name='br-int',has_traffic_filtering=True,id=5790346b-5f12-43ca-8348-7401eff36734,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5790346b-5f') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5790346b-5f, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49e8ed01-89ac-4f0e-aa0c-4e426c1a267c) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:53 user nova-compute[75342]: INFO os_vif [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:53:c1,bridge_name='br-int',has_traffic_filtering=True,id=5790346b-5f12-43ca-8348-7401eff36734,network=Network(b834cf36-0c9f-4e46-a91c-dda85f95337b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5790346b-5f')
Nov 16 18:19:53 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Deleting instance files /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d_del
Nov 16 18:19:53 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Deletion of /opt/stack/data/nova/instances/d0385123-12ff-41a3-a78d-ac5ce325ae0d_del complete
Nov 16 18:19:53 user nova-compute[75342]: INFO nova.compute.manager [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 16 18:19:53 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:19:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-77b0fdf4-50b7-4476-9db1-af893079a8ef req-2979a48a-d768-4cf5-b192-945d4b4d024a service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-deleted-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:54 user nova-compute[75342]: INFO nova.compute.manager [req-77b0fdf4-50b7-4476-9db1-af893079a8ef req-2979a48a-d768-4cf5-b192-945d4b4d024a service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Neutron deleted interface 5790346b-5f12-43ca-8348-7401eff36734; detaching it from the instance and deleting it from the info cache
Nov 16 18:19:54 user nova-compute[75342]: DEBUG nova.network.neutron [req-77b0fdf4-50b7-4476-9db1-af893079a8ef req-2979a48a-d768-4cf5-b192-945d4b4d024a service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:19:54 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Took 0.71 seconds to deallocate network for instance.
Nov 16 18:19:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-77b0fdf4-50b7-4476-9db1-af893079a8ef req-2979a48a-d768-4cf5-b192-945d4b4d024a service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Detach interface failed, port_id=5790346b-5f12-43ca-8348-7401eff36734, reason: Instance d0385123-12ff-41a3-a78d-ac5ce325ae0d could not be found. {{(pid=75342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:19:54 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:55 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Deleted allocations for instance d0385123-12ff-41a3-a78d-ac5ce325ae0d
Nov 16 18:19:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-403190ae-7a69-4305-99c5-cea740509bdd tempest-ServerRescueNegativeTestJSON-935902109 tempest-ServerRescueNegativeTestJSON-935902109-project-member] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.339s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:55 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid 'd0385123-12ff-41a3-a78d-ac5ce325ae0d' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd0385123-12ff-41a3-a78d-ac5ce325ae0d' (instance-0000000f)
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-3c61cb21-7bfa-4818-a423-5bc9a1c1037f req-5d7533be-4e8b-424c-9a84-b5059408ef7b service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3c61cb21-7bfa-4818-a423-5bc9a1c1037f req-5d7533be-4e8b-424c-9a84-b5059408ef7b service nova] Acquiring lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3c61cb21-7bfa-4818-a423-5bc9a1c1037f req-5d7533be-4e8b-424c-9a84-b5059408ef7b service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3c61cb21-7bfa-4818-a423-5bc9a1c1037f req-5d7533be-4e8b-424c-9a84-b5059408ef7b service nova] Lock "d0385123-12ff-41a3-a78d-ac5ce325ae0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-3c61cb21-7bfa-4818-a423-5bc9a1c1037f req-5d7533be-4e8b-424c-9a84-b5059408ef7b service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] No waiting events found dispatching network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:19:55 user nova-compute[75342]: WARNING nova.compute.manager [req-3c61cb21-7bfa-4818-a423-5bc9a1c1037f req-5d7533be-4e8b-424c-9a84-b5059408ef7b service nova] [instance: d0385123-12ff-41a3-a78d-ac5ce325ae0d] Received unexpected event network-vif-plugged-5790346b-5f12-43ca-8348-7401eff36734 for instance with vm_state deleted and task_state None.
Nov 16 18:19:55 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:19:55 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8307MB free_disk=25.281005859375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bd8e6fae-5355-449f-a552-e90f74d189d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance c9e9c604-3ed1-4162-b30e-629f34748c87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 08da7bca-b538-4c74-8bbf-a55268c1c84c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 5edd2a74-89b9-4163-b452-d491be30059b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:19:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:19:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:19:56 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:19:56 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:19:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:19:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:19:57 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:19:57 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 01d59cab-ff4e-4c62-92cc-50eca7089f6f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:19:57 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Updating instance_info_cache with network_info: [{"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:19:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-01d59cab-ff4e-4c62-92cc-50eca7089f6f" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:19:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:19:57 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:19:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:19:58 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:03 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f is timed out.
Nov 16 18:20:03 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully detached device vdb from instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f from the live domain config.
Nov 16 18:20:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSwYrIlt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:20:03 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dda1442-0c13-4fc5-8167-6645d61d76c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:20:03 user nova-compute[75342]: No targets found.
Nov 16 18:20:03 user nova-compute[75342]: iSNS:
Nov 16 18:20:03 user nova-compute[75342]: No targets found.
Nov 16 18:20:03 user nova-compute[75342]: STATIC:
Nov 16 18:20:03 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c
Nov 16 18:20:03 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:20:03 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:20:03 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53
Nov 16 18:20:03 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:20:03 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:20:03 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431
Nov 16 18:20:03 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:20:03 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:20:03 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da
Nov 16 18:20:03 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:20:03 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:20:03 user nova-compute[75342]: FIRMWARE:
Nov 16 18:20:03 user nova-compute[75342]: No targets found.
Nov 16 18:20:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:20:03 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:20:03 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c9fb15-13c5-47fc-ac3e-07e63d349904]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc532b7-be2e-4e64-82a1-69edb2c77a51]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:20:03 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:20:03 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:20:03 user nova-compute[75342]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 (non-flash)
Nov 16 18:20:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:20:03 user nova-compute[75342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 (non-flash)
Nov 16 18:20:03 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:20:03 user nova-compute[75342]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 (non-flash)
Nov 16 18:20:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a464a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ea8450-9e27-4b44-be17-fb67d0f1008a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fbff42-ada4-4d5d-be7f-0325d04108b0]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e919720c-5427-4c6f-aa22-729ba81d963d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cfaf25-9759-4ab7-b4f2-cdadb5203f47]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7df0653-c0b9-4466-8677-0ec40145fdc0]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[073fcdc4-2940-414e-9c27-7dbeaedb9342]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431, portal: 172.16.0.220,3260]
Nov 16 18:20:03 user nova-compute[75342]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431, portal: 172.16.0.220,3260] successful.
Nov 16 18:20:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e769e6c-61d0-4a59-8c38-136d6d260431 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[50be11cc-871e-49f2-9920-f516b844cb5a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] <== disconnect_volume: return (367ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:20:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:20:04 user nova-compute[75342]: DEBUG nova.objects.instance [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 01d59cab-ff4e-4c62-92cc-50eca7089f6f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:20:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-79b1598a-3f9a-4a86-b576-68f490c03c79 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.865s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:05 user nova-compute[75342]: INFO nova.compute.manager [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Detaching volume 16c17861-91b0-4de7-89dc-6e05a9b9af53
Nov 16 18:20:05 user nova-compute[75342]: INFO nova.virt.block_device [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Attempting to driver detach volume 16c17861-91b0-4de7-89dc-6e05a9b9af53 from mountpoint /dev/vdc
Nov 16 18:20:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Attempting to detach device vdc from instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:20:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:20:05 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:20:05 user nova-compute[75342]:   <source dev="/dev/sde"/>
Nov 16 18:20:05 user nova-compute[75342]:   <target dev="vdc" bus="virtio"/>
Nov 16 18:20:05 user nova-compute[75342]:   <serial>16c17861-91b0-4de7-89dc-6e05a9b9af53</serial>
Nov 16 18:20:05 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 18:20:05 user nova-compute[75342]: </disk>
Nov 16 18:20:05 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:20:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully detached device vdc from instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f from the persistent domain config.
Nov 16 18:20:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:20:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:20:05 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:20:05 user nova-compute[75342]:   <source dev="/dev/sde"/>
Nov 16 18:20:05 user nova-compute[75342]:   <target dev="vdc" bus="virtio"/>
Nov 16 18:20:05 user nova-compute[75342]:   <serial>16c17861-91b0-4de7-89dc-6e05a9b9af53</serial>
Nov 16 18:20:05 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 18:20:05 user nova-compute[75342]: </disk>
Nov 16 18:20:05 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:20:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:20:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:20:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:20:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:20:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:20:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:26 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f is timed out.
Nov 16 18:20:26 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully detached device vdc from instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f from the live domain config.
Nov 16 18:20:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALluBrSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:20:26 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1325c91-84ba-4c62-9b5f-8bd1f97d2f3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:20:26 user nova-compute[75342]: No targets found.
Nov 16 18:20:26 user nova-compute[75342]: iSNS:
Nov 16 18:20:26 user nova-compute[75342]: No targets found.
Nov 16 18:20:26 user nova-compute[75342]: STATIC:
Nov 16 18:20:26 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c
Nov 16 18:20:26 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:20:26 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:20:26 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53
Nov 16 18:20:26 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:20:26 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:20:26 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da
Nov 16 18:20:26 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:20:26 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:20:26 user nova-compute[75342]: FIRMWARE:
Nov 16 18:20:26 user nova-compute[75342]: No targets found.
Nov 16 18:20:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:20:26 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:20:26 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda57c8f-acc8-4bb9-be0b-b3ce8f843deb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57e33c1-f6a2-4906-a781-7eb008f83213]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:20:26 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:20:26 user nova-compute[75342]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 (non-flash)
Nov 16 18:20:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:20:26 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:20:26 user nova-compute[75342]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 (non-flash)
Nov 16 18:20:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6d13d5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53'): ({'sde'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Removing single pathed devices sde {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8214823a-bb3d-4398-91be-a50ba2aeadf6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4459c3f-651d-443e-8a9c-c7e08c2e275c]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Flushing IO for device /dev/sde {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f089f8-c5f9-4e85-a1ce-68b7104875cd]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22864fe-5ac3-47f8-bd25-125f6ab7dffd]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOea50041d-dd5dcbb37443179f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ea50041d', '/dev/disk/by-id/scsi-26464356463626233') {{(pid=85570) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a430a1-a8c6-41c2-9854-8d43397f5b09]: (4, None) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc30661c-a87c-44e6-a068-8e385c3edd9f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c17be67-cc99-45f3-99fd-e5056d011645]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53, portal: 172.16.0.220,3260]
Nov 16 18:20:26 user nova-compute[75342]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53, portal: 172.16.0.220,3260] successful.
Nov 16 18:20:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c17861-91b0-4de7-89dc-6e05a9b9af53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb02370f-183e-4996-ad15-bc531bf1f642]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] <== disconnect_volume: return (293ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:20:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:20:27 user nova-compute[75342]: DEBUG nova.objects.instance [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'flavor' on Instance uuid 01d59cab-ff4e-4c62-92cc-50eca7089f6f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:20:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ef111f2a-6454-4c7c-878c-fe6bbb2d8169 tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.622s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:28 user nova-compute[75342]: INFO nova.compute.manager [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Terminating instance
Nov 16 18:20:28 user nova-compute[75342]: DEBUG nova.compute.manager [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-96615b61-2553-4d71-908d-2c6041347b59 req-d32d9d26-087e-4927-96b4-905dbc882652 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Received event network-vif-unplugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-96615b61-2553-4d71-908d-2c6041347b59 req-d32d9d26-087e-4927-96b4-905dbc882652 service nova] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-96615b61-2553-4d71-908d-2c6041347b59 req-d32d9d26-087e-4927-96b4-905dbc882652 service nova] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-96615b61-2553-4d71-908d-2c6041347b59 req-d32d9d26-087e-4927-96b4-905dbc882652 service nova] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-96615b61-2553-4d71-908d-2c6041347b59 req-d32d9d26-087e-4927-96b4-905dbc882652 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] No waiting events found dispatching network-vif-unplugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG nova.compute.manager [req-96615b61-2553-4d71-908d-2c6041347b59 req-d32d9d26-087e-4927-96b4-905dbc882652 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Received event network-vif-unplugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:20:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:29 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Instance destroyed successfully.
Nov 16 18:20:29 user nova-compute[75342]: DEBUG nova.objects.instance [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lazy-loading 'resources' on Instance uuid 01d59cab-ff4e-4c62-92cc-50eca7089f6f {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-231509914',display_name='tempest-AttachVolumeTestJSON-server-231509914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-231509914',id=37,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEklYip5of/khCdwX2XmwZLShcRmqFBI9rG/qEROhbyuGDtEGXOFi9VRQtFk10uUhfSiSilOVJSbAk02/dhyLCrrOtrM9RjWFkwQ7Nn80PO6YawNXKgoLEmfxpbQ0GiIIA==',key_name='tempest-keypair-725961595',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:17:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b7dafce5e534279b01a17644c620e36',ramdisk_id='',reservation_id='r-82i8w713',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-410390487',owner_user_name='tempest-AttachVolumeTestJSON-410390487-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da0d585d0e04be284e3eb50ce093d89',uuid=01d59cab-ff4e-4c62-92cc-50eca7089f6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converting VIF {"id": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "address": "fa:16:3e:d6:a5:e7", "network": {"id": "7aabd900-5974-4602-9c85-f9cfbfddaad4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1357081541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b7dafce5e534279b01a17644c620e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8603ce17-5b", "ovs_interfaceid": "8603ce17-5b31-4dda-8c75-8ff1e75675fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a5:e7,bridge_name='br-int',has_traffic_filtering=True,id=8603ce17-5b31-4dda-8c75-8ff1e75675fc,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8603ce17-5b') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG os_vif [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a5:e7,bridge_name='br-int',has_traffic_filtering=True,id=8603ce17-5b31-4dda-8c75-8ff1e75675fc,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8603ce17-5b') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8603ce17-5b, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42785676-815a-47f8-9942-6c82b3a3051f) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:20:29 user nova-compute[75342]: INFO os_vif [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a5:e7,bridge_name='br-int',has_traffic_filtering=True,id=8603ce17-5b31-4dda-8c75-8ff1e75675fc,network=Network(7aabd900-5974-4602-9c85-f9cfbfddaad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8603ce17-5b')
Nov 16 18:20:29 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Deleting instance files /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f_del
Nov 16 18:20:29 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Deletion of /opt/stack/data/nova/instances/01d59cab-ff4e-4c62-92cc-50eca7089f6f_del complete
Nov 16 18:20:29 user nova-compute[75342]: INFO nova.compute.manager [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 16 18:20:29 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:20:29 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:20:29 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Took 0.73 seconds to deallocate network for instance.
Nov 16 18:20:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-f310bed3-ec5b-4715-916f-64941f25ba5f req-dfce0336-2580-4aa7-b835-88637c040287 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Received event network-vif-deleted-8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:20:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:30 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:20:30 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:20:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:30 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Deleted allocations for instance 01d59cab-ff4e-4c62-92cc-50eca7089f6f
Nov 16 18:20:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-365ac3ed-be5a-4a3b-8bd9-c586d1e2383e tempest-AttachVolumeTestJSON-410390487 tempest-AttachVolumeTestJSON-410390487-project-member] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.949s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-6639c9d7-e07d-462c-9e91-285bed17dee7 req-986d004b-4491-4de3-acfb-1690cb4d83b5 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Received event network-vif-plugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:20:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6639c9d7-e07d-462c-9e91-285bed17dee7 req-986d004b-4491-4de3-acfb-1690cb4d83b5 service nova] Acquiring lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6639c9d7-e07d-462c-9e91-285bed17dee7 req-986d004b-4491-4de3-acfb-1690cb4d83b5 service nova] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6639c9d7-e07d-462c-9e91-285bed17dee7 req-986d004b-4491-4de3-acfb-1690cb4d83b5 service nova] Lock "01d59cab-ff4e-4c62-92cc-50eca7089f6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:30 user nova-compute[75342]: DEBUG nova.compute.manager [req-6639c9d7-e07d-462c-9e91-285bed17dee7 req-986d004b-4491-4de3-acfb-1690cb4d83b5 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] No waiting events found dispatching network-vif-plugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:20:30 user nova-compute[75342]: WARNING nova.compute.manager [req-6639c9d7-e07d-462c-9e91-285bed17dee7 req-986d004b-4491-4de3-acfb-1690cb4d83b5 service nova] [instance: 01d59cab-ff4e-4c62-92cc-50eca7089f6f] Received unexpected event network-vif-plugged-8603ce17-5b31-4dda-8c75-8ff1e75675fc for instance with vm_state deleted and task_state None.
Nov 16 18:20:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Acquiring lock "c9e9c604-3ed1-4162-b30e-629f34748c87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Acquiring lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:35 user nova-compute[75342]: INFO nova.compute.manager [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Terminating instance
Nov 16 18:20:35 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-b1b3ccb3-ef28-4adf-bee8-27cd84304ee3 req-bfdf92b3-97b8-4cb0-aa22-0ea5be7b3abe service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Received event network-vif-unplugged-f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b1b3ccb3-ef28-4adf-bee8-27cd84304ee3 req-bfdf92b3-97b8-4cb0-aa22-0ea5be7b3abe service nova] Acquiring lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b1b3ccb3-ef28-4adf-bee8-27cd84304ee3 req-bfdf92b3-97b8-4cb0-aa22-0ea5be7b3abe service nova] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b1b3ccb3-ef28-4adf-bee8-27cd84304ee3 req-bfdf92b3-97b8-4cb0-aa22-0ea5be7b3abe service nova] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-b1b3ccb3-ef28-4adf-bee8-27cd84304ee3 req-bfdf92b3-97b8-4cb0-aa22-0ea5be7b3abe service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] No waiting events found dispatching network-vif-unplugged-f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:20:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-b1b3ccb3-ef28-4adf-bee8-27cd84304ee3 req-bfdf92b3-97b8-4cb0-aa22-0ea5be7b3abe service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Received event network-vif-unplugged-f327819a-a3a9-4a62-af5b-93eb4581e280 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:20:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Instance destroyed successfully.
Nov 16 18:20:36 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lazy-loading 'resources' on Instance uuid c9e9c604-3ed1-4162-b30e-629f34748c87 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1926772768',display_name='tempest-VolumesNegativeTest-instance-1926772768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1926772768',id=39,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e18bddcf9be84795bd84ea4357099937',ramdisk_id='',reservation_id='r-nb6035lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1852274216',owner_user_name='tempest-VolumesNegativeTest-1852274216-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:18:51Z,user_data=None,user_id='54fed81f64cd4b7482325a8ac6e4c1b4',uuid=c9e9c604-3ed1-4162-b30e-629f34748c87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f327819a-a3a9-4a62-af5b-93eb4581e280", "address": "fa:16:3e:ae:6f:00", "network": {"id": "4f021b06-bd26-4245-a06c-ce3555653e07", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cde44693ac4d4e6aa4874162714c9ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf327819a-a3", "ovs_interfaceid": "f327819a-a3a9-4a62-af5b-93eb4581e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Converting VIF {"id": "f327819a-a3a9-4a62-af5b-93eb4581e280", "address": "fa:16:3e:ae:6f:00", "network": {"id": "4f021b06-bd26-4245-a06c-ce3555653e07", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cde44693ac4d4e6aa4874162714c9ba9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf327819a-a3", "ovs_interfaceid": "f327819a-a3a9-4a62-af5b-93eb4581e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:6f:00,bridge_name='br-int',has_traffic_filtering=True,id=f327819a-a3a9-4a62-af5b-93eb4581e280,network=Network(4f021b06-bd26-4245-a06c-ce3555653e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf327819a-a3') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG os_vif [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:6f:00,bridge_name='br-int',has_traffic_filtering=True,id=f327819a-a3a9-4a62-af5b-93eb4581e280,network=Network(4f021b06-bd26-4245-a06c-ce3555653e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf327819a-a3') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf327819a-a3, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c555dcc-a581-4696-98ef-74558500b6d8) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:36 user nova-compute[75342]: INFO os_vif [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:6f:00,bridge_name='br-int',has_traffic_filtering=True,id=f327819a-a3a9-4a62-af5b-93eb4581e280,network=Network(4f021b06-bd26-4245-a06c-ce3555653e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf327819a-a3')
Nov 16 18:20:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Deleting instance files /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87_del
Nov 16 18:20:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Deletion of /opt/stack/data/nova/instances/c9e9c604-3ed1-4162-b30e-629f34748c87_del complete
Nov 16 18:20:36 user nova-compute[75342]: INFO nova.compute.manager [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 16 18:20:36 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:20:36 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:20:36 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Took 0.65 seconds to deallocate network for instance.
Nov 16 18:20:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-527ae46d-3ff3-433d-a521-f96d47e6e8e5 req-03f12b13-4164-431a-bd09-a14aacae9aa8 service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Received event network-vif-deleted-f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:20:37 user nova-compute[75342]: INFO nova.compute.manager [req-527ae46d-3ff3-433d-a521-f96d47e6e8e5 req-03f12b13-4164-431a-bd09-a14aacae9aa8 service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Neutron deleted interface f327819a-a3a9-4a62-af5b-93eb4581e280; detaching it from the instance and deleting it from the info cache
Nov 16 18:20:37 user nova-compute[75342]: DEBUG nova.network.neutron [req-527ae46d-3ff3-433d-a521-f96d47e6e8e5 req-03f12b13-4164-431a-bd09-a14aacae9aa8 service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:20:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-527ae46d-3ff3-433d-a521-f96d47e6e8e5 req-03f12b13-4164-431a-bd09-a14aacae9aa8 service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Detach interface failed, port_id=f327819a-a3a9-4a62-af5b-93eb4581e280, reason: Instance c9e9c604-3ed1-4162-b30e-629f34748c87 could not be found. {{(pid=75342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 18:20:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:37 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:20:37 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:20:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:37 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Deleted allocations for instance c9e9c604-3ed1-4162-b30e-629f34748c87
Nov 16 18:20:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1e4fc1f3-7069-4a34-941d-44b6265e1173 tempest-VolumesNegativeTest-1852274216 tempest-VolumesNegativeTest-1852274216-project-member] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.985s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-d544cf28-3b3f-4bc1-b2cf-27e26da67b29 req-facc5d70-f363-4dc1-a4f4-5729b6df3ee1 service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Received event network-vif-plugged-f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:20:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d544cf28-3b3f-4bc1-b2cf-27e26da67b29 req-facc5d70-f363-4dc1-a4f4-5729b6df3ee1 service nova] Acquiring lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d544cf28-3b3f-4bc1-b2cf-27e26da67b29 req-facc5d70-f363-4dc1-a4f4-5729b6df3ee1 service nova] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d544cf28-3b3f-4bc1-b2cf-27e26da67b29 req-facc5d70-f363-4dc1-a4f4-5729b6df3ee1 service nova] Lock "c9e9c604-3ed1-4162-b30e-629f34748c87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-d544cf28-3b3f-4bc1-b2cf-27e26da67b29 req-facc5d70-f363-4dc1-a4f4-5729b6df3ee1 service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] No waiting events found dispatching network-vif-plugged-f327819a-a3a9-4a62-af5b-93eb4581e280 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:20:37 user nova-compute[75342]: WARNING nova.compute.manager [req-d544cf28-3b3f-4bc1-b2cf-27e26da67b29 req-facc5d70-f363-4dc1-a4f4-5729b6df3ee1 service nova] [instance: c9e9c604-3ed1-4162-b30e-629f34748c87] Received unexpected event network-vif-plugged-f327819a-a3a9-4a62-af5b-93eb4581e280 for instance with vm_state deleted and task_state None.
Nov 16 18:20:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:43 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 18:20:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] There are 0 instances to clean {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 18:20:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:48 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:48 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:20:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 18:20:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:53 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:54 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:20:54 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8584MB free_disk=25.324935913085938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bd8e6fae-5355-449f-a552-e90f74d189d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 08da7bca-b538-4c74-8bbf-a55268c1c84c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 5edd2a74-89b9-4163-b452-d491be30059b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing inventories for resource provider fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating ProviderTree inventory for provider fdd6b940-75a0-4315-8416-79157aaeea59 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing aggregate associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, aggregates: None {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing trait associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, traits: COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:20:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:56 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:20:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:20:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:20:56 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:20:56 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Updating instance_info_cache with network_info: [{"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:20:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:20:56 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:20:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:20:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:20:58 user nova-compute[75342]: INFO nova.compute.claims [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Claim successful on node user
Nov 16 18:20:58 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:20:58 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:20:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG nova.policy [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48aea12e1e7c40f69b90ce451a9bf745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afab8ca8fb0e4810aff37187498d3855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:20:58 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Creating image(s)
Nov 16 18:20:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "/opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "/opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "/opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk 1073741824" returned: 0 in 0.047s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Successfully created port: ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Cannot resize image /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Ensure instance console log exists: /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Successfully updated port: ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "refresh_cache-6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquired lock "refresh_cache-6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG nova.compute.manager [req-e2f5424e-136d-4320-80eb-5782d8541f67 req-17bac0ae-ee6a-4a36-b877-90dfcee04f75 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-changed-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG nova.compute.manager [req-e2f5424e-136d-4320-80eb-5782d8541f67 req-17bac0ae-ee6a-4a36-b877-90dfcee04f75 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Refreshing instance network info cache due to event network-changed-ddb1369d-547f-46d2-b7b2-feb2743ceef1. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e2f5424e-136d-4320-80eb-5782d8541f67 req-17bac0ae-ee6a-4a36-b877-90dfcee04f75 service nova] Acquiring lock "refresh_cache-6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:20:59 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Updating instance_info_cache with network_info: [{"id": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "address": "fa:16:3e:f8:df:e7", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb1369d-54", "ovs_interfaceid": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Releasing lock "refresh_cache-6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Instance network_info: |[{"id": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "address": "fa:16:3e:f8:df:e7", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb1369d-54", "ovs_interfaceid": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e2f5424e-136d-4320-80eb-5782d8541f67 req-17bac0ae-ee6a-4a36-b877-90dfcee04f75 service nova] Acquired lock "refresh_cache-6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.network.neutron [req-e2f5424e-136d-4320-80eb-5782d8541f67 req-17bac0ae-ee6a-4a36-b877-90dfcee04f75 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Refreshing network info cache for port ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Start _get_guest_xml network_info=[{"id": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "address": "fa:16:3e:f8:df:e7", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb1369d-54", "ovs_interfaceid": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:21:00 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:21:00 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1225174140',display_name='tempest-VolumesSnapshotTestJSON-instance-1225174140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1225174140',id=42,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQMJI2FM8Gqw7dIn9/1hLI7gFICP4VfC1b78zmxSe0XBX7r0/TbdCxOlfnXg9w/IKok87VkFCwIoK5bALfE6ewIo2ioe+MAHFzkgk3xgKv7YOOPZmJT7rBCHxmyGs9e8A==',key_name='tempest-keypair-509822917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afab8ca8fb0e4810aff37187498d3855',ramdisk_id='',reservation_id='r-uyzstzjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-31047705',owner_user_name='tempest-VolumesSnapshotTestJSON-31047705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48aea12e1e7c40f69b90ce451a9bf745',uuid=6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "address": "fa:16:3e:f8:df:e7", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb1369d-54", "ovs_interfaceid": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converting VIF {"id": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "address": "fa:16:3e:f8:df:e7", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb1369d-54", "ovs_interfaceid": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:e7,bridge_name='br-int',has_traffic_filtering=True,id=ddb1369d-547f-46d2-b7b2-feb2743ceef1,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb1369d-54') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.objects.instance [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lazy-loading 'pci_devices' on Instance uuid 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:21:00 user nova-compute[75342]:   <uuid>6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8</uuid>
Nov 16 18:21:00 user nova-compute[75342]:   <name>instance-0000002a</name>
Nov 16 18:21:00 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:21:00 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:21:00 user nova-compute[75342]:   <metadata>
Nov 16 18:21:00 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:21:00 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:21:00 user nova-compute[75342]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1225174140</nova:name>
Nov 16 18:21:00 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:21:00</nova:creationTime>
Nov 16 18:21:00 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:21:00 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:21:00 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:21:00 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:21:00 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:21:00 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:21:00 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:21:00 user nova-compute[75342]:       <nova:owner>
Nov 16 18:21:00 user nova-compute[75342]:         <nova:user uuid="48aea12e1e7c40f69b90ce451a9bf745">tempest-VolumesSnapshotTestJSON-31047705-project-member</nova:user>
Nov 16 18:21:00 user nova-compute[75342]:         <nova:project uuid="afab8ca8fb0e4810aff37187498d3855">tempest-VolumesSnapshotTestJSON-31047705</nova:project>
Nov 16 18:21:00 user nova-compute[75342]:       </nova:owner>
Nov 16 18:21:00 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:21:00 user nova-compute[75342]:       <nova:ports>
Nov 16 18:21:00 user nova-compute[75342]:         <nova:port uuid="ddb1369d-547f-46d2-b7b2-feb2743ceef1">
Nov 16 18:21:00 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 18:21:00 user nova-compute[75342]:         </nova:port>
Nov 16 18:21:00 user nova-compute[75342]:       </nova:ports>
Nov 16 18:21:00 user nova-compute[75342]:     </nova:instance>
Nov 16 18:21:00 user nova-compute[75342]:   </metadata>
Nov 16 18:21:00 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:21:00 user nova-compute[75342]:     <system>
Nov 16 18:21:00 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:21:00 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:21:00 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:21:00 user nova-compute[75342]:       <entry name="serial">6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8</entry>
Nov 16 18:21:00 user nova-compute[75342]:       <entry name="uuid">6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8</entry>
Nov 16 18:21:00 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:21:00 user nova-compute[75342]:     </system>
Nov 16 18:21:00 user nova-compute[75342]:   </sysinfo>
Nov 16 18:21:00 user nova-compute[75342]:   <os>
Nov 16 18:21:00 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:21:00 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:21:00 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:21:00 user nova-compute[75342]:   </os>
Nov 16 18:21:00 user nova-compute[75342]:   <features>
Nov 16 18:21:00 user nova-compute[75342]:     <acpi/>
Nov 16 18:21:00 user nova-compute[75342]:     <apic/>
Nov 16 18:21:00 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:21:00 user nova-compute[75342]:   </features>
Nov 16 18:21:00 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:21:00 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:21:00 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:21:00 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:21:00 user nova-compute[75342]:   </clock>
Nov 16 18:21:00 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:21:00 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:21:00 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:21:00 user nova-compute[75342]:   </cpu>
Nov 16 18:21:00 user nova-compute[75342]:   <devices>
Nov 16 18:21:00 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:21:00 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:21:00 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk"/>
Nov 16 18:21:00 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:21:00 user nova-compute[75342]:     </disk>
Nov 16 18:21:00 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:21:00 user nova-compute[75342]:       <mac address="fa:16:3e:f8:df:e7"/>
Nov 16 18:21:00 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:21:00 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:21:00 user nova-compute[75342]:       <target dev="tapddb1369d-54"/>
Nov 16 18:21:00 user nova-compute[75342]:     </interface>
Nov 16 18:21:00 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:21:00 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/console.log" append="off"/>
Nov 16 18:21:00 user nova-compute[75342]:     </serial>
Nov 16 18:21:00 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:21:00 user nova-compute[75342]:     <video>
Nov 16 18:21:00 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:21:00 user nova-compute[75342]:     </video>
Nov 16 18:21:00 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:21:00 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:21:00 user nova-compute[75342]:     </rng>
Nov 16 18:21:00 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:21:00 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:21:00 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:21:00 user nova-compute[75342]:     </memballoon>
Nov 16 18:21:00 user nova-compute[75342]:   </devices>
Nov 16 18:21:00 user nova-compute[75342]: </domain>
Nov 16 18:21:00 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1225174140',display_name='tempest-VolumesSnapshotTestJSON-instance-1225174140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1225174140',id=42,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQMJI2FM8Gqw7dIn9/1hLI7gFICP4VfC1b78zmxSe0XBX7r0/TbdCxOlfnXg9w/IKok87VkFCwIoK5bALfE6ewIo2ioe+MAHFzkgk3xgKv7YOOPZmJT7rBCHxmyGs9e8A==',key_name='tempest-keypair-509822917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afab8ca8fb0e4810aff37187498d3855',ramdisk_id='',reservation_id='r-uyzstzjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-31047705',owner_user_name='tempest-VolumesSnapshotTestJSON-31047705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48aea12e1e7c40f69b90ce451a9bf745',uuid=6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "address": "fa:16:3e:f8:df:e7", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb1369d-54", "ovs_interfaceid": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converting VIF {"id": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "address": "fa:16:3e:f8:df:e7", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb1369d-54", "ovs_interfaceid": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:e7,bridge_name='br-int',has_traffic_filtering=True,id=ddb1369d-547f-46d2-b7b2-feb2743ceef1,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb1369d-54') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG os_vif [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:e7,bridge_name='br-int',has_traffic_filtering=True,id=ddb1369d-547f-46d2-b7b2-feb2743ceef1,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb1369d-54') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f8067fe-31ef-50dc-9754-7327104114db', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddb1369d-54, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddb1369d-54, col_values=(('qos', UUID('97a4e8b7-d299-48de-9253-80edb2767ef1')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddb1369d-54, col_values=(('external_ids', {'iface-id': 'ddb1369d-547f-46d2-b7b2-feb2743ceef1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:df:e7', 'vm-uuid': '6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:00 user nova-compute[75342]: INFO os_vif [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:e7,bridge_name='br-int',has_traffic_filtering=True,id=ddb1369d-547f-46d2-b7b2-feb2743ceef1,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb1369d-54')
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] No VIF found with MAC fa:16:3e:f8:df:e7, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.network.neutron [req-e2f5424e-136d-4320-80eb-5782d8541f67 req-17bac0ae-ee6a-4a36-b877-90dfcee04f75 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Updated VIF entry in instance network info cache for port ddb1369d-547f-46d2-b7b2-feb2743ceef1. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG nova.network.neutron [req-e2f5424e-136d-4320-80eb-5782d8541f67 req-17bac0ae-ee6a-4a36-b877-90dfcee04f75 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Updating instance_info_cache with network_info: [{"id": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "address": "fa:16:3e:f8:df:e7", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb1369d-54", "ovs_interfaceid": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e2f5424e-136d-4320-80eb-5782d8541f67 req-17bac0ae-ee6a-4a36-b877-90dfcee04f75 service nova] Releasing lock "refresh_cache-6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:21:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:01 user nova-compute[75342]: DEBUG nova.compute.manager [req-ddbde7d5-ba90-4032-977e-2a3fa67147b2 req-8f45b4f6-0bea-47b4-961c-2fbcc7c00d75 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ddbde7d5-ba90-4032-977e-2a3fa67147b2 req-8f45b4f6-0bea-47b4-961c-2fbcc7c00d75 service nova] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ddbde7d5-ba90-4032-977e-2a3fa67147b2 req-8f45b4f6-0bea-47b4-961c-2fbcc7c00d75 service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ddbde7d5-ba90-4032-977e-2a3fa67147b2 req-8f45b4f6-0bea-47b4-961c-2fbcc7c00d75 service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:01 user nova-compute[75342]: DEBUG nova.compute.manager [req-ddbde7d5-ba90-4032-977e-2a3fa67147b2 req-8f45b4f6-0bea-47b4-961c-2fbcc7c00d75 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] No waiting events found dispatching network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:21:01 user nova-compute[75342]: WARNING nova.compute.manager [req-ddbde7d5-ba90-4032-977e-2a3fa67147b2 req-8f45b4f6-0bea-47b4-961c-2fbcc7c00d75 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received unexpected event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 for instance with vm_state building and task_state spawning.
Nov 16 18:21:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:21:03 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Instance spawned successfully.
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-9f5e6b9e-8ae2-42be-94d1-0a5c24c9e064 req-0e37b477-ea60-4d56-9d75-6f60cc72e9a1 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9f5e6b9e-8ae2-42be-94d1-0a5c24c9e064 req-0e37b477-ea60-4d56-9d75-6f60cc72e9a1 service nova] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9f5e6b9e-8ae2-42be-94d1-0a5c24c9e064 req-0e37b477-ea60-4d56-9d75-6f60cc72e9a1 service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9f5e6b9e-8ae2-42be-94d1-0a5c24c9e064 req-0e37b477-ea60-4d56-9d75-6f60cc72e9a1 service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-9f5e6b9e-8ae2-42be-94d1-0a5c24c9e064 req-0e37b477-ea60-4d56-9d75-6f60cc72e9a1 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] No waiting events found dispatching network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:21:03 user nova-compute[75342]: WARNING nova.compute.manager [req-9f5e6b9e-8ae2-42be-94d1-0a5c24c9e064 req-0e37b477-ea60-4d56-9d75-6f60cc72e9a1 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received unexpected event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 for instance with vm_state building and task_state spawning.
Nov 16 18:21:03 user nova-compute[75342]: INFO nova.compute.manager [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 16 18:21:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:21:04 user nova-compute[75342]: INFO nova.compute.manager [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Took 5.98 seconds to build instance.
Nov 16 18:21:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c47a3036-2960-4be4-a52b-0997f916336c tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.070s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:21:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:21:14 user nova-compute[75342]: INFO nova.compute.claims [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Claim successful on node user
Nov 16 18:21:14 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:21:14 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:21:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:21:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:21:14 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:21:15 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:21:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:21:15 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Creating image(s)
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "/opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "/opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG nova.policy [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8824c1e02e5e41a7beb3a08a5e5b7124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30aa87387053460b9575cd8fb070af29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk 1073741824" returned: 0 in 0.052s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Cannot resize image /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Ensure instance console log exists: /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:15 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Successfully created port: 81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Successfully updated port: 81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquired lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG nova.compute.manager [req-b33de332-8f9f-4ce3-a62b-1d244e863f19 req-8df13d05-e615-4d8d-beda-8b0d0b3cb0cc service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received event network-changed-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG nova.compute.manager [req-b33de332-8f9f-4ce3-a62b-1d244e863f19 req-8df13d05-e615-4d8d-beda-8b0d0b3cb0cc service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Refreshing instance network info cache due to event network-changed-81d7a65f-87b1-474c-877c-03f5dec5113c. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b33de332-8f9f-4ce3-a62b-1d244e863f19 req-8df13d05-e615-4d8d-beda-8b0d0b3cb0cc service nova] Acquiring lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG nova.network.neutron [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updating instance_info_cache with network_info: [{"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Releasing lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Instance network_info: |[{"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b33de332-8f9f-4ce3-a62b-1d244e863f19 req-8df13d05-e615-4d8d-beda-8b0d0b3cb0cc service nova] Acquired lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:21:16 user nova-compute[75342]: DEBUG nova.network.neutron [req-b33de332-8f9f-4ce3-a62b-1d244e863f19 req-8df13d05-e615-4d8d-beda-8b0d0b3cb0cc service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Refreshing network info cache for port 81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Start _get_guest_xml network_info=[{"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:21:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:21:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1606760862',display_name='tempest-TestStampPattern-server-1606760862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1606760862',id=43,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWRDrITjp8lV/bdrgBAnPtDPz8fSKsjO1nF68velNrRvChHnjZw1cZB/Ss4eCH0mBq/oxSBLNXAorbiApAZVZPOeZgKRGyEshGk6TU4B3fctyTamQK6QGS51fl7NMXCbw==',key_name='tempest-TestStampPattern-842187603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30aa87387053460b9575cd8fb070af29',ramdisk_id='',reservation_id='r-53doc6mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1612033621',owner_user_name='tempest-TestStampPattern-1612033621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:21:15Z,user_data=None,user_id='8824c1e02e5e41a7beb3a08a5e5b7124',uuid=9fb5b39f-affa-4dc0-b38a-3e3bfad36495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converting VIF {"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=81d7a65f-87b1-474c-877c-03f5dec5113c,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d7a65f-87') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.objects.instance [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:21:17 user nova-compute[75342]:   <uuid>9fb5b39f-affa-4dc0-b38a-3e3bfad36495</uuid>
Nov 16 18:21:17 user nova-compute[75342]:   <name>instance-0000002b</name>
Nov 16 18:21:17 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:21:17 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:21:17 user nova-compute[75342]:   <metadata>
Nov 16 18:21:17 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:21:17 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:21:17 user nova-compute[75342]:       <nova:name>tempest-TestStampPattern-server-1606760862</nova:name>
Nov 16 18:21:17 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:21:17</nova:creationTime>
Nov 16 18:21:17 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:21:17 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:21:17 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:21:17 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:21:17 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:21:17 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:21:17 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:21:17 user nova-compute[75342]:       <nova:owner>
Nov 16 18:21:17 user nova-compute[75342]:         <nova:user uuid="8824c1e02e5e41a7beb3a08a5e5b7124">tempest-TestStampPattern-1612033621-project-member</nova:user>
Nov 16 18:21:17 user nova-compute[75342]:         <nova:project uuid="30aa87387053460b9575cd8fb070af29">tempest-TestStampPattern-1612033621</nova:project>
Nov 16 18:21:17 user nova-compute[75342]:       </nova:owner>
Nov 16 18:21:17 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:21:17 user nova-compute[75342]:       <nova:ports>
Nov 16 18:21:17 user nova-compute[75342]:         <nova:port uuid="81d7a65f-87b1-474c-877c-03f5dec5113c">
Nov 16 18:21:17 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 18:21:17 user nova-compute[75342]:         </nova:port>
Nov 16 18:21:17 user nova-compute[75342]:       </nova:ports>
Nov 16 18:21:17 user nova-compute[75342]:     </nova:instance>
Nov 16 18:21:17 user nova-compute[75342]:   </metadata>
Nov 16 18:21:17 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:21:17 user nova-compute[75342]:     <system>
Nov 16 18:21:17 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:21:17 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:21:17 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:21:17 user nova-compute[75342]:       <entry name="serial">9fb5b39f-affa-4dc0-b38a-3e3bfad36495</entry>
Nov 16 18:21:17 user nova-compute[75342]:       <entry name="uuid">9fb5b39f-affa-4dc0-b38a-3e3bfad36495</entry>
Nov 16 18:21:17 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:21:17 user nova-compute[75342]:     </system>
Nov 16 18:21:17 user nova-compute[75342]:   </sysinfo>
Nov 16 18:21:17 user nova-compute[75342]:   <os>
Nov 16 18:21:17 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:21:17 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:21:17 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:21:17 user nova-compute[75342]:   </os>
Nov 16 18:21:17 user nova-compute[75342]:   <features>
Nov 16 18:21:17 user nova-compute[75342]:     <acpi/>
Nov 16 18:21:17 user nova-compute[75342]:     <apic/>
Nov 16 18:21:17 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:21:17 user nova-compute[75342]:   </features>
Nov 16 18:21:17 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:21:17 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:21:17 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:21:17 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:21:17 user nova-compute[75342]:   </clock>
Nov 16 18:21:17 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:21:17 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:21:17 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:21:17 user nova-compute[75342]:   </cpu>
Nov 16 18:21:17 user nova-compute[75342]:   <devices>
Nov 16 18:21:17 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:21:17 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:21:17 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk"/>
Nov 16 18:21:17 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:21:17 user nova-compute[75342]:     </disk>
Nov 16 18:21:17 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:21:17 user nova-compute[75342]:       <mac address="fa:16:3e:2a:89:a9"/>
Nov 16 18:21:17 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:21:17 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:21:17 user nova-compute[75342]:       <target dev="tap81d7a65f-87"/>
Nov 16 18:21:17 user nova-compute[75342]:     </interface>
Nov 16 18:21:17 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:21:17 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/console.log" append="off"/>
Nov 16 18:21:17 user nova-compute[75342]:     </serial>
Nov 16 18:21:17 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:21:17 user nova-compute[75342]:     <video>
Nov 16 18:21:17 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:21:17 user nova-compute[75342]:     </video>
Nov 16 18:21:17 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:21:17 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:21:17 user nova-compute[75342]:     </rng>
Nov 16 18:21:17 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:21:17 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:21:17 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:21:17 user nova-compute[75342]:     </memballoon>
Nov 16 18:21:17 user nova-compute[75342]:   </devices>
Nov 16 18:21:17 user nova-compute[75342]: </domain>
Nov 16 18:21:17 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1606760862',display_name='tempest-TestStampPattern-server-1606760862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1606760862',id=43,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWRDrITjp8lV/bdrgBAnPtDPz8fSKsjO1nF68velNrRvChHnjZw1cZB/Ss4eCH0mBq/oxSBLNXAorbiApAZVZPOeZgKRGyEshGk6TU4B3fctyTamQK6QGS51fl7NMXCbw==',key_name='tempest-TestStampPattern-842187603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30aa87387053460b9575cd8fb070af29',ramdisk_id='',reservation_id='r-53doc6mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1612033621',owner_user_name='tempest-TestStampPattern-1612033621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:21:15Z,user_data=None,user_id='8824c1e02e5e41a7beb3a08a5e5b7124',uuid=9fb5b39f-affa-4dc0-b38a-3e3bfad36495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converting VIF {"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=81d7a65f-87b1-474c-877c-03f5dec5113c,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d7a65f-87') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG os_vif [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=81d7a65f-87b1-474c-877c-03f5dec5113c,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d7a65f-87') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1512462a-5b72-5a88-8704-c523d8925f61', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81d7a65f-87, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81d7a65f-87, col_values=(('qos', UUID('44a74993-e1ae-46a0-803e-b4facdecf6e8')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81d7a65f-87, col_values=(('external_ids', {'iface-id': '81d7a65f-87b1-474c-877c-03f5dec5113c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:89:a9', 'vm-uuid': '9fb5b39f-affa-4dc0-b38a-3e3bfad36495'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:17 user nova-compute[75342]: INFO os_vif [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=81d7a65f-87b1-474c-877c-03f5dec5113c,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d7a65f-87')
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] No VIF found with MAC fa:16:3e:2a:89:a9, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.network.neutron [req-b33de332-8f9f-4ce3-a62b-1d244e863f19 req-8df13d05-e615-4d8d-beda-8b0d0b3cb0cc service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updated VIF entry in instance network info cache for port 81d7a65f-87b1-474c-877c-03f5dec5113c. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG nova.network.neutron [req-b33de332-8f9f-4ce3-a62b-1d244e863f19 req-8df13d05-e615-4d8d-beda-8b0d0b3cb0cc service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updating instance_info_cache with network_info: [{"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b33de332-8f9f-4ce3-a62b-1d244e863f19 req-8df13d05-e615-4d8d-beda-8b0d0b3cb0cc service nova] Releasing lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:21:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:18 user nova-compute[75342]: DEBUG nova.compute.manager [req-354330d8-4959-4228-8c6b-48131c66f12a req-e84ba5fd-83ec-44f4-8857-590d54efacdb service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received event network-vif-plugged-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-354330d8-4959-4228-8c6b-48131c66f12a req-e84ba5fd-83ec-44f4-8857-590d54efacdb service nova] Acquiring lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-354330d8-4959-4228-8c6b-48131c66f12a req-e84ba5fd-83ec-44f4-8857-590d54efacdb service nova] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-354330d8-4959-4228-8c6b-48131c66f12a req-e84ba5fd-83ec-44f4-8857-590d54efacdb service nova] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:18 user nova-compute[75342]: DEBUG nova.compute.manager [req-354330d8-4959-4228-8c6b-48131c66f12a req-e84ba5fd-83ec-44f4-8857-590d54efacdb service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] No waiting events found dispatching network-vif-plugged-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:21:18 user nova-compute[75342]: WARNING nova.compute.manager [req-354330d8-4959-4228-8c6b-48131c66f12a req-e84ba5fd-83ec-44f4-8857-590d54efacdb service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received unexpected event network-vif-plugged-81d7a65f-87b1-474c-877c-03f5dec5113c for instance with vm_state building and task_state spawning.
Nov 16 18:21:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-e26a8cd0-71b3-476e-9a81-ec2ee79b86d4 req-abefb25b-c38c-4705-a68f-d01ee7550973 service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received event network-vif-plugged-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e26a8cd0-71b3-476e-9a81-ec2ee79b86d4 req-abefb25b-c38c-4705-a68f-d01ee7550973 service nova] Acquiring lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e26a8cd0-71b3-476e-9a81-ec2ee79b86d4 req-abefb25b-c38c-4705-a68f-d01ee7550973 service nova] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e26a8cd0-71b3-476e-9a81-ec2ee79b86d4 req-abefb25b-c38c-4705-a68f-d01ee7550973 service nova] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-e26a8cd0-71b3-476e-9a81-ec2ee79b86d4 req-abefb25b-c38c-4705-a68f-d01ee7550973 service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] No waiting events found dispatching network-vif-plugged-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:21:20 user nova-compute[75342]: WARNING nova.compute.manager [req-e26a8cd0-71b3-476e-9a81-ec2ee79b86d4 req-abefb25b-c38c-4705-a68f-d01ee7550973 service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received unexpected event network-vif-plugged-81d7a65f-87b1-474c-877c-03f5dec5113c for instance with vm_state building and task_state spawning.
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:21:20 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Instance spawned successfully.
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:20 user nova-compute[75342]: INFO nova.compute.manager [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 16 18:21:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:21:20 user nova-compute[75342]: INFO nova.compute.manager [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Took 6.28 seconds to build instance.
Nov 16 18:21:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e8f547e6-435d-4511-9fe3-fc52c2571101 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.383s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-bc90889a-fd30-4dd4-b643-5ecd5282228e req-9702ecca-cc87-42e1-bf36-6159b0c827bb service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received event network-changed-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-bc90889a-fd30-4dd4-b643-5ecd5282228e req-9702ecca-cc87-42e1-bf36-6159b0c827bb service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Refreshing instance network info cache due to event network-changed-e45d55f9-5951-469c-ae64-9d35dd755b37. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-bc90889a-fd30-4dd4-b643-5ecd5282228e req-9702ecca-cc87-42e1-bf36-6159b0c827bb service nova] Acquiring lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-bc90889a-fd30-4dd4-b643-5ecd5282228e req-9702ecca-cc87-42e1-bf36-6159b0c827bb service nova] Acquired lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG nova.network.neutron [req-bc90889a-fd30-4dd4-b643-5ecd5282228e req-9702ecca-cc87-42e1-bf36-6159b0c827bb service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Refreshing network info cache for port e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG nova.network.neutron [req-bc90889a-fd30-4dd4-b643-5ecd5282228e req-9702ecca-cc87-42e1-bf36-6159b0c827bb service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Updated VIF entry in instance network info cache for port e45d55f9-5951-469c-ae64-9d35dd755b37. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG nova.network.neutron [req-bc90889a-fd30-4dd4-b643-5ecd5282228e req-9702ecca-cc87-42e1-bf36-6159b0c827bb service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Updating instance_info_cache with network_info: [{"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-bc90889a-fd30-4dd4-b643-5ecd5282228e req-9702ecca-cc87-42e1-bf36-6159b0c827bb service nova] Releasing lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "08da7bca-b538-4c74-8bbf-a55268c1c84c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:21 user nova-compute[75342]: INFO nova.compute.manager [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Terminating instance
Nov 16 18:21:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-5ac7e4c6-f256-455f-af58-7a32daba8dd3 req-8b0695fc-77ff-4644-91ff-a755d36d37e0 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received event network-changed-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-5ac7e4c6-f256-455f-af58-7a32daba8dd3 req-8b0695fc-77ff-4644-91ff-a755d36d37e0 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Refreshing instance network info cache due to event network-changed-e45d55f9-5951-469c-ae64-9d35dd755b37. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5ac7e4c6-f256-455f-af58-7a32daba8dd3 req-8b0695fc-77ff-4644-91ff-a755d36d37e0 service nova] Acquiring lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5ac7e4c6-f256-455f-af58-7a32daba8dd3 req-8b0695fc-77ff-4644-91ff-a755d36d37e0 service nova] Acquired lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG nova.network.neutron [req-5ac7e4c6-f256-455f-af58-7a32daba8dd3 req-8b0695fc-77ff-4644-91ff-a755d36d37e0 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Refreshing network info cache for port e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:21:22 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Instance destroyed successfully.
Nov 16 18:21:22 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'resources' on Instance uuid 08da7bca-b538-4c74-8bbf-a55268c1c84c {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:19:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-133675700',display_name='tempest-TestVolumeBootPattern-server-133675700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-133675700',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxsC14B7FXvV2fSoMtlJDAqdPeFWveN/Z0Ifom/f6iLWm22eKeX4OVWWNojR/qqP5b5ZDw4QQNhLxzsgEQuPgfcqpGQNglCOOs11ACZVIFU1+eY4bhyAYc4WrWEkoqGQ==',key_name='tempest-TestVolumeBootPattern-2105905581',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:19:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-41jderxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:19:40Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=08da7bca-b538-4c74-8bbf-a55268c1c84c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=e45d55f9-5951-469c-ae64-9d35dd755b37,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45d55f9-59') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG os_vif [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=e45d55f9-5951-469c-ae64-9d35dd755b37,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45d55f9-59') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape45d55f9-59, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85a97067-bc7b-4c4a-be29-fe8b57cd0038) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:21:22 user nova-compute[75342]: INFO os_vif [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=e45d55f9-5951-469c-ae64-9d35dd755b37,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45d55f9-59')
Nov 16 18:21:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arJlgwen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:21:22 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:21:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ddfbda-8162-447d-a4ba-206a7e12c8a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:21:22 user nova-compute[75342]: No targets found.
Nov 16 18:21:22 user nova-compute[75342]: iSNS:
Nov 16 18:21:22 user nova-compute[75342]: No targets found.
Nov 16 18:21:22 user nova-compute[75342]: STATIC:
Nov 16 18:21:22 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c
Nov 16 18:21:22 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:21:22 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:21:22 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da
Nov 16 18:21:22 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:21:22 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:21:22 user nova-compute[75342]: FIRMWARE:
Nov 16 18:21:22 user nova-compute[75342]: No targets found.
Nov 16 18:21:22 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:21:22 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:21:22 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0fcc97-647e-4642-8a73-be6505b9cdea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc04824-8f7f-4eef-ab70-a41091d81d3c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:21:22 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:21:22 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:21:22 user nova-compute[75342]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c (non-flash)
Nov 16 18:21:22 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4635090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c'): ({'sdd'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Removing single pathed devices sdd {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae30424-6e92-4b80-9672-0b375faf4b51]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:21:22 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d79463-7ae8-4381-8d18-ac88bd15bcf0]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flushing IO for device /dev/sdd {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca37146-2bcf-4b9b-87a3-6d11e30ba300]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ff3540-8016-4b0a-a454-cc7abb09b83d]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received event network-vif-unplugged-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] Acquiring lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] No waiting events found dispatching network-vif-unplugged-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received event network-vif-unplugged-e45d55f9-5951-469c-ae64-9d35dd755b37 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received event network-vif-plugged-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] Acquiring lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] No waiting events found dispatching network-vif-plugged-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:21:23 user nova-compute[75342]: WARNING nova.compute.manager [req-eb161c76-0fd4-4335-8326-6ff8863d39c8 req-31858f02-e1bb-4686-9946-bc22f0e3ec6c service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received unexpected event network-vif-plugged-e45d55f9-5951-469c-ae64-9d35dd755b37 for instance with vm_state active and task_state deleting.
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d32a3d-a106-41ca-ab5e-821f5bb45b24]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[485625c3-9727-42a3-894f-d6e45918c1db]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c, portal: 172.16.0.220,3260]
Nov 16 18:21:23 user nova-compute[75342]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c, portal: 172.16.0.220,3260] successful.
Nov 16 18:21:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c1584b-fc42-4619-afe0-78c5cc22bd4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[569be9c0-b8e8-4fbf-82d6-0869c1a97072]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== disconnect_volume: return (352ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:21:23 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Deleting instance files /opt/stack/data/nova/instances/08da7bca-b538-4c74-8bbf-a55268c1c84c_del
Nov 16 18:21:23 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Deletion of /opt/stack/data/nova/instances/08da7bca-b538-4c74-8bbf-a55268c1c84c_del complete
Nov 16 18:21:23 user nova-compute[75342]: INFO nova.compute.manager [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG nova.network.neutron [req-5ac7e4c6-f256-455f-af58-7a32daba8dd3 req-8b0695fc-77ff-4644-91ff-a755d36d37e0 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Updated VIF entry in instance network info cache for port e45d55f9-5951-469c-ae64-9d35dd755b37. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG nova.network.neutron [req-5ac7e4c6-f256-455f-af58-7a32daba8dd3 req-8b0695fc-77ff-4644-91ff-a755d36d37e0 service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Updating instance_info_cache with network_info: [{"id": "e45d55f9-5951-469c-ae64-9d35dd755b37", "address": "fa:16:3e:4e:f3:10", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45d55f9-59", "ovs_interfaceid": "e45d55f9-5951-469c-ae64-9d35dd755b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5ac7e4c6-f256-455f-af58-7a32daba8dd3 req-8b0695fc-77ff-4644-91ff-a755d36d37e0 service nova] Releasing lock "refresh_cache-08da7bca-b538-4c74-8bbf-a55268c1c84c" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:23 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:23 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Took 0.60 seconds to deallocate network for instance.
Nov 16 18:21:24 user nova-compute[75342]: INFO nova.compute.manager [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Took 0.76 seconds to detach 1 volumes for instance.
Nov 16 18:21:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:24 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:21:24 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:21:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:25 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Deleted allocations for instance 08da7bca-b538-4c74-8bbf-a55268c1c84c
Nov 16 18:21:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b695e8d2-8023-4de8-ac27-7026799ce006 tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "08da7bca-b538-4c74-8bbf-a55268c1c84c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.180s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:25 user nova-compute[75342]: DEBUG nova.compute.manager [req-840cbe1a-6e86-43ed-8eea-9145c85716ee req-c2d0c636-b080-45b8-8f57-f41d7cb6ed1a service nova] [instance: 08da7bca-b538-4c74-8bbf-a55268c1c84c] Received event network-vif-deleted-e45d55f9-5951-469c-ae64-9d35dd755b37 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-9091ac4d-b396-4116-9d47-bcea6031d49f req-720f3447-6976-4433-86ad-385ae3324a16 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-changed-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-9091ac4d-b396-4116-9d47-bcea6031d49f req-720f3447-6976-4433-86ad-385ae3324a16 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Refreshing instance network info cache due to event network-changed-e421c3fa-c93c-486e-9658-a24ae8089927. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:21:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9091ac4d-b396-4116-9d47-bcea6031d49f req-720f3447-6976-4433-86ad-385ae3324a16 service nova] Acquiring lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:21:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9091ac4d-b396-4116-9d47-bcea6031d49f req-720f3447-6976-4433-86ad-385ae3324a16 service nova] Acquired lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:21:34 user nova-compute[75342]: DEBUG nova.network.neutron [req-9091ac4d-b396-4116-9d47-bcea6031d49f req-720f3447-6976-4433-86ad-385ae3324a16 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Refreshing network info cache for port e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:21:34 user nova-compute[75342]: DEBUG nova.network.neutron [req-9091ac4d-b396-4116-9d47-bcea6031d49f req-720f3447-6976-4433-86ad-385ae3324a16 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updated VIF entry in instance network info cache for port e421c3fa-c93c-486e-9658-a24ae8089927. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:21:34 user nova-compute[75342]: DEBUG nova.network.neutron [req-9091ac4d-b396-4116-9d47-bcea6031d49f req-720f3447-6976-4433-86ad-385ae3324a16 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updating instance_info_cache with network_info: [{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-9091ac4d-b396-4116-9d47-bcea6031d49f req-720f3447-6976-4433-86ad-385ae3324a16 service nova] Releasing lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:21:35 user nova-compute[75342]: DEBUG nova.compute.manager [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:21:35 user nova-compute[75342]: INFO nova.compute.manager [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] instance snapshotting
Nov 16 18:21:35 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Beginning live snapshot process
Nov 16 18:21:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json -f qcow2 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json -f qcow2 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnyq2wxqp/f7ea19299570425d8d322a1468b4a3f7.delta 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnyq2wxqp/f7ea19299570425d8d322a1468b4a3f7.delta 1073741824" returned: 0 in 0.079s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 18:21:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:21:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:21:37 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 18:21:38 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:21:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnyq2wxqp/f7ea19299570425d8d322a1468b4a3f7.delta /opt/stack/data/nova/instances/snapshots/tmpnyq2wxqp/f7ea19299570425d8d322a1468b4a3f7 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnyq2wxqp/f7ea19299570425d8d322a1468b4a3f7.delta /opt/stack/data/nova/instances/snapshots/tmpnyq2wxqp/f7ea19299570425d8d322a1468b4a3f7" returned: 0 in 0.653s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:38 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Snapshot extracted, beginning image upload
Nov 16 18:21:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:41 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Snapshot image upload complete
Nov 16 18:21:41 user nova-compute[75342]: INFO nova.compute.manager [None req-7ff9ddf3-8884-4110-8d2d-bc49b3d90635 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Took 5.52 seconds to snapshot the instance on the hypervisor.
Nov 16 18:21:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:21:43 user nova-compute[75342]: INFO nova.compute.claims [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Claim successful on node user
Nov 16 18:21:43 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG nova.network.neutron [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:21:43 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:21:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG nova.policy [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6df4253086b4db8b675a6e1b2436b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af578b4b43744644b720ab37606f9752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:21:43 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Creating image(s)
Nov 16 18:21:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "/opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "/opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "/opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk 1073741824" returned: 0 in 0.049s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Cannot resize image /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Ensure instance console log exists: /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Successfully created port: c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:21:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Successfully updated port: c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:21:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:21:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquired lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:21:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:21:45 user nova-compute[75342]: DEBUG nova.network.neutron [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:21:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-8fb4fe69-9200-44f7-8e3a-168736c3d595 req-523e10bf-8945-49ea-b684-cc4bad442a8d service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Received event network-changed-c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:45 user nova-compute[75342]: DEBUG nova.compute.manager [req-8fb4fe69-9200-44f7-8e3a-168736c3d595 req-523e10bf-8945-49ea-b684-cc4bad442a8d service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Refreshing instance network info cache due to event network-changed-c3ba5522-4a54-4d69-838c-1ee676262ef1. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:21:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8fb4fe69-9200-44f7-8e3a-168736c3d595 req-523e10bf-8945-49ea-b684-cc4bad442a8d service nova] Acquiring lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.network.neutron [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Updating instance_info_cache with network_info: [{"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Releasing lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.compute.manager [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Instance network_info: |[{"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8fb4fe69-9200-44f7-8e3a-168736c3d595 req-523e10bf-8945-49ea-b684-cc4bad442a8d service nova] Acquired lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.network.neutron [req-8fb4fe69-9200-44f7-8e3a-168736c3d595 req-523e10bf-8945-49ea-b684-cc4bad442a8d service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Refreshing network info cache for port c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Start _get_guest_xml network_info=[{"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:21:46 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:21:46 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1894375165',display_name='tempest-AttachVolumeNegativeTest-server-1894375165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1894375165',id=44,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWJ4+3VoXzPgUlhMA2lm082mH8FIrl1rngApNoOfDfcWBzhP5xst8CV0MB/oXa3oydB+GsbfwwGR0grDVRyxE7TaKWR42iUc9rjjFZASQdRUsi5YyiGYe/FZqKz+2OoOw==',key_name='tempest-keypair-1682407278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-e0dq14um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=c3ba5522-4a54-4d69-838c-1ee676262ef1,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ba5522-4a') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'pci_devices' on Instance uuid f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:21:46 user nova-compute[75342]:   <uuid>f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d</uuid>
Nov 16 18:21:46 user nova-compute[75342]:   <name>instance-0000002c</name>
Nov 16 18:21:46 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:21:46 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:21:46 user nova-compute[75342]:   <metadata>
Nov 16 18:21:46 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:21:46 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:21:46 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1894375165</nova:name>
Nov 16 18:21:46 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:21:46</nova:creationTime>
Nov 16 18:21:46 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:21:46 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:21:46 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:21:46 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:21:46 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:21:46 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:21:46 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:21:46 user nova-compute[75342]:       <nova:owner>
Nov 16 18:21:46 user nova-compute[75342]:         <nova:user uuid="c6df4253086b4db8b675a6e1b2436b87">tempest-AttachVolumeNegativeTest-825910471-project-member</nova:user>
Nov 16 18:21:46 user nova-compute[75342]:         <nova:project uuid="af578b4b43744644b720ab37606f9752">tempest-AttachVolumeNegativeTest-825910471</nova:project>
Nov 16 18:21:46 user nova-compute[75342]:       </nova:owner>
Nov 16 18:21:46 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:21:46 user nova-compute[75342]:       <nova:ports>
Nov 16 18:21:46 user nova-compute[75342]:         <nova:port uuid="c3ba5522-4a54-4d69-838c-1ee676262ef1">
Nov 16 18:21:46 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 18:21:46 user nova-compute[75342]:         </nova:port>
Nov 16 18:21:46 user nova-compute[75342]:       </nova:ports>
Nov 16 18:21:46 user nova-compute[75342]:     </nova:instance>
Nov 16 18:21:46 user nova-compute[75342]:   </metadata>
Nov 16 18:21:46 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:21:46 user nova-compute[75342]:     <system>
Nov 16 18:21:46 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:21:46 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:21:46 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:21:46 user nova-compute[75342]:       <entry name="serial">f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d</entry>
Nov 16 18:21:46 user nova-compute[75342]:       <entry name="uuid">f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d</entry>
Nov 16 18:21:46 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:21:46 user nova-compute[75342]:     </system>
Nov 16 18:21:46 user nova-compute[75342]:   </sysinfo>
Nov 16 18:21:46 user nova-compute[75342]:   <os>
Nov 16 18:21:46 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:21:46 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:21:46 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:21:46 user nova-compute[75342]:   </os>
Nov 16 18:21:46 user nova-compute[75342]:   <features>
Nov 16 18:21:46 user nova-compute[75342]:     <acpi/>
Nov 16 18:21:46 user nova-compute[75342]:     <apic/>
Nov 16 18:21:46 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:21:46 user nova-compute[75342]:   </features>
Nov 16 18:21:46 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:21:46 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:21:46 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:21:46 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:21:46 user nova-compute[75342]:   </clock>
Nov 16 18:21:46 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:21:46 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:21:46 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:21:46 user nova-compute[75342]:   </cpu>
Nov 16 18:21:46 user nova-compute[75342]:   <devices>
Nov 16 18:21:46 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:21:46 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:21:46 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk"/>
Nov 16 18:21:46 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:21:46 user nova-compute[75342]:     </disk>
Nov 16 18:21:46 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:21:46 user nova-compute[75342]:       <mac address="fa:16:3e:07:34:2a"/>
Nov 16 18:21:46 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:21:46 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:21:46 user nova-compute[75342]:       <target dev="tapc3ba5522-4a"/>
Nov 16 18:21:46 user nova-compute[75342]:     </interface>
Nov 16 18:21:46 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:21:46 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/console.log" append="off"/>
Nov 16 18:21:46 user nova-compute[75342]:     </serial>
Nov 16 18:21:46 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:21:46 user nova-compute[75342]:     <video>
Nov 16 18:21:46 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:21:46 user nova-compute[75342]:     </video>
Nov 16 18:21:46 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:21:46 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:21:46 user nova-compute[75342]:     </rng>
Nov 16 18:21:46 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:21:46 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:21:46 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:21:46 user nova-compute[75342]:     </memballoon>
Nov 16 18:21:46 user nova-compute[75342]:   </devices>
Nov 16 18:21:46 user nova-compute[75342]: </domain>
Nov 16 18:21:46 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1894375165',display_name='tempest-AttachVolumeNegativeTest-server-1894375165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1894375165',id=44,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWJ4+3VoXzPgUlhMA2lm082mH8FIrl1rngApNoOfDfcWBzhP5xst8CV0MB/oXa3oydB+GsbfwwGR0grDVRyxE7TaKWR42iUc9rjjFZASQdRUsi5YyiGYe/FZqKz+2OoOw==',key_name='tempest-keypair-1682407278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-e0dq14um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=c3ba5522-4a54-4d69-838c-1ee676262ef1,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ba5522-4a') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG os_vif [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=c3ba5522-4a54-4d69-838c-1ee676262ef1,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ba5522-4a') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e843907-ed24-52ef-acd8-e96823ee155e', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3ba5522-4a, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3ba5522-4a, col_values=(('qos', UUID('38893b9d-c7d1-4978-855a-1942bcc00f04')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3ba5522-4a, col_values=(('external_ids', {'iface-id': 'c3ba5522-4a54-4d69-838c-1ee676262ef1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:34:2a', 'vm-uuid': 'f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:46 user nova-compute[75342]: INFO os_vif [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=c3ba5522-4a54-4d69-838c-1ee676262ef1,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ba5522-4a')
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No VIF found with MAC fa:16:3e:07:34:2a, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.network.neutron [req-8fb4fe69-9200-44f7-8e3a-168736c3d595 req-523e10bf-8945-49ea-b684-cc4bad442a8d service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Updated VIF entry in instance network info cache for port c3ba5522-4a54-4d69-838c-1ee676262ef1. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG nova.network.neutron [req-8fb4fe69-9200-44f7-8e3a-168736c3d595 req-523e10bf-8945-49ea-b684-cc4bad442a8d service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Updating instance_info_cache with network_info: [{"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8fb4fe69-9200-44f7-8e3a-168736c3d595 req-523e10bf-8945-49ea-b684-cc4bad442a8d service nova] Releasing lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:21:47 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:21:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-e7397a72-1b52-43d1-a2ca-65e9e3b45b4d req-0c653cc1-d2fc-4d6e-b09b-6612a893a2b1 service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Received event network-vif-plugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7397a72-1b52-43d1-a2ca-65e9e3b45b4d req-0c653cc1-d2fc-4d6e-b09b-6612a893a2b1 service nova] Acquiring lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7397a72-1b52-43d1-a2ca-65e9e3b45b4d req-0c653cc1-d2fc-4d6e-b09b-6612a893a2b1 service nova] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7397a72-1b52-43d1-a2ca-65e9e3b45b4d req-0c653cc1-d2fc-4d6e-b09b-6612a893a2b1 service nova] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-e7397a72-1b52-43d1-a2ca-65e9e3b45b4d req-0c653cc1-d2fc-4d6e-b09b-6612a893a2b1 service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] No waiting events found dispatching network-vif-plugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:21:48 user nova-compute[75342]: WARNING nova.compute.manager [req-e7397a72-1b52-43d1-a2ca-65e9e3b45b4d req-0c653cc1-d2fc-4d6e-b09b-6612a893a2b1 service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Received unexpected event network-vif-plugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 for instance with vm_state building and task_state spawning.
Nov 16 18:21:48 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:21:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:21:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:21:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:21:49 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Instance spawned successfully.
Nov 16 18:21:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:21:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:21:49 user nova-compute[75342]: INFO nova.compute.manager [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 16 18:21:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:21:50 user nova-compute[75342]: INFO nova.compute.manager [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Took 6.91 seconds to build instance.
Nov 16 18:21:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f2c17b03-cc18-484b-93c5-48f71de217ca tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.049s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:21:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:21:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-5635e395-4441-48e7-8747-bc45e6acca67 req-e5239db3-ccbe-44ea-8d65-aec079ec3c9b service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Received event network-vif-plugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5635e395-4441-48e7-8747-bc45e6acca67 req-e5239db3-ccbe-44ea-8d65-aec079ec3c9b service nova] Acquiring lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5635e395-4441-48e7-8747-bc45e6acca67 req-e5239db3-ccbe-44ea-8d65-aec079ec3c9b service nova] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5635e395-4441-48e7-8747-bc45e6acca67 req-e5239db3-ccbe-44ea-8d65-aec079ec3c9b service nova] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-5635e395-4441-48e7-8747-bc45e6acca67 req-e5239db3-ccbe-44ea-8d65-aec079ec3c9b service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] No waiting events found dispatching network-vif-plugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:21:50 user nova-compute[75342]: WARNING nova.compute.manager [req-5635e395-4441-48e7-8747-bc45e6acca67 req-e5239db3-ccbe-44ea-8d65-aec079ec3c9b service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Received unexpected event network-vif-plugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 for instance with vm_state active and task_state None.
Nov 16 18:21:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:21:53 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:21:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:56 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:21:56 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8338MB free_disk=25.204242706298828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance bd8e6fae-5355-449f-a552-e90f74d189d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 5edd2a74-89b9-4163-b452-d491be30059b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.manager [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.147s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:56 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:21:56 user nova-compute[75342]: INFO nova.compute.claims [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Claim successful on node user
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.network.neutron [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:21:57 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:21:57 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Creating image(s)
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "/opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "/opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "/opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.policy [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ccae5b59579145658e1e5170763158cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a214817c58484919adc5dd06fc588977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk 1073741824" returned: 0 in 0.053s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:21:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Cannot resize image /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Ensure instance console log exists: /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG nova.network.neutron [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Successfully created port: 9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updating instance_info_cache with network_info: [{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG nova.network.neutron [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Successfully updated port: 9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquired lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG nova.network.neutron [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-59837df9-5951-4339-93b1-b7645c20070f req-614e3581-e77c-42fa-be0c-7dd089ee2a05 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Received event network-changed-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG nova.compute.manager [req-59837df9-5951-4339-93b1-b7645c20070f req-614e3581-e77c-42fa-be0c-7dd089ee2a05 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Refreshing instance network info cache due to event network-changed-9f2f4b77-ea5f-44cd-a9e6-a48449c85641. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-59837df9-5951-4339-93b1-b7645c20070f req-614e3581-e77c-42fa-be0c-7dd089ee2a05 service nova] Acquiring lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:21:58 user nova-compute[75342]: DEBUG nova.network.neutron [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.network.neutron [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updating instance_info_cache with network_info: [{"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Releasing lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.compute.manager [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Instance network_info: |[{"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-59837df9-5951-4339-93b1-b7645c20070f req-614e3581-e77c-42fa-be0c-7dd089ee2a05 service nova] Acquired lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.network.neutron [req-59837df9-5951-4339-93b1-b7645c20070f req-614e3581-e77c-42fa-be0c-7dd089ee2a05 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Refreshing network info cache for port 9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Start _get_guest_xml network_info=[{"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:21:59 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:21:59 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-408569235',display_name='tempest-SnapshotDataIntegrityTests-server-408569235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-408569235',id=45,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOcM9oUP53yA60pnkVXuYbvv6k+GSc14Hf7oIZBXy+VoDNHQTlBapUQBoYPADfKQfYXuI6Fnpf++TWYJ2gPoQ0P0H8Q6qMgtRopEUDlcbwY6h5HZf5rKR/g9GTRaEvlrQ==',key_name='tempest-keypair-1706832352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a214817c58484919adc5dd06fc588977',ramdisk_id='',reservation_id='r-a0j5d93z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-904336717',owner_user_name='tempest-SnapshotDataIntegrityTests-904336717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:21:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccae5b59579145658e1e5170763158cb',uuid=952e341a-db9a-45e6-b3a3-6e97ab8ae524,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Converting VIF {"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d6:05,bridge_name='br-int',has_traffic_filtering=True,id=9f2f4b77-ea5f-44cd-a9e6-a48449c85641,network=Network(2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f2f4b77-ea') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.objects.instance [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'pci_devices' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:21:59 user nova-compute[75342]:   <uuid>952e341a-db9a-45e6-b3a3-6e97ab8ae524</uuid>
Nov 16 18:21:59 user nova-compute[75342]:   <name>instance-0000002d</name>
Nov 16 18:21:59 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:21:59 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:21:59 user nova-compute[75342]:   <metadata>
Nov 16 18:21:59 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:21:59 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:21:59 user nova-compute[75342]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-408569235</nova:name>
Nov 16 18:21:59 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:21:59</nova:creationTime>
Nov 16 18:21:59 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:21:59 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:21:59 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:21:59 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:21:59 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:21:59 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:21:59 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:21:59 user nova-compute[75342]:       <nova:owner>
Nov 16 18:21:59 user nova-compute[75342]:         <nova:user uuid="ccae5b59579145658e1e5170763158cb">tempest-SnapshotDataIntegrityTests-904336717-project-member</nova:user>
Nov 16 18:21:59 user nova-compute[75342]:         <nova:project uuid="a214817c58484919adc5dd06fc588977">tempest-SnapshotDataIntegrityTests-904336717</nova:project>
Nov 16 18:21:59 user nova-compute[75342]:       </nova:owner>
Nov 16 18:21:59 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:21:59 user nova-compute[75342]:       <nova:ports>
Nov 16 18:21:59 user nova-compute[75342]:         <nova:port uuid="9f2f4b77-ea5f-44cd-a9e6-a48449c85641">
Nov 16 18:21:59 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 18:21:59 user nova-compute[75342]:         </nova:port>
Nov 16 18:21:59 user nova-compute[75342]:       </nova:ports>
Nov 16 18:21:59 user nova-compute[75342]:     </nova:instance>
Nov 16 18:21:59 user nova-compute[75342]:   </metadata>
Nov 16 18:21:59 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:21:59 user nova-compute[75342]:     <system>
Nov 16 18:21:59 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:21:59 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:21:59 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:21:59 user nova-compute[75342]:       <entry name="serial">952e341a-db9a-45e6-b3a3-6e97ab8ae524</entry>
Nov 16 18:21:59 user nova-compute[75342]:       <entry name="uuid">952e341a-db9a-45e6-b3a3-6e97ab8ae524</entry>
Nov 16 18:21:59 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:21:59 user nova-compute[75342]:     </system>
Nov 16 18:21:59 user nova-compute[75342]:   </sysinfo>
Nov 16 18:21:59 user nova-compute[75342]:   <os>
Nov 16 18:21:59 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:21:59 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:21:59 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:21:59 user nova-compute[75342]:   </os>
Nov 16 18:21:59 user nova-compute[75342]:   <features>
Nov 16 18:21:59 user nova-compute[75342]:     <acpi/>
Nov 16 18:21:59 user nova-compute[75342]:     <apic/>
Nov 16 18:21:59 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:21:59 user nova-compute[75342]:   </features>
Nov 16 18:21:59 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:21:59 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:21:59 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:21:59 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:21:59 user nova-compute[75342]:   </clock>
Nov 16 18:21:59 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:21:59 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:21:59 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:21:59 user nova-compute[75342]:   </cpu>
Nov 16 18:21:59 user nova-compute[75342]:   <devices>
Nov 16 18:21:59 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:21:59 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:21:59 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk"/>
Nov 16 18:21:59 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:21:59 user nova-compute[75342]:     </disk>
Nov 16 18:21:59 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:21:59 user nova-compute[75342]:       <mac address="fa:16:3e:a1:d6:05"/>
Nov 16 18:21:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:21:59 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:21:59 user nova-compute[75342]:       <target dev="tap9f2f4b77-ea"/>
Nov 16 18:21:59 user nova-compute[75342]:     </interface>
Nov 16 18:21:59 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:21:59 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/console.log" append="off"/>
Nov 16 18:21:59 user nova-compute[75342]:     </serial>
Nov 16 18:21:59 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:21:59 user nova-compute[75342]:     <video>
Nov 16 18:21:59 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:21:59 user nova-compute[75342]:     </video>
Nov 16 18:21:59 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:21:59 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:21:59 user nova-compute[75342]:     </rng>
Nov 16 18:21:59 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:21:59 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:21:59 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:21:59 user nova-compute[75342]:     </memballoon>
Nov 16 18:21:59 user nova-compute[75342]:   </devices>
Nov 16 18:21:59 user nova-compute[75342]: </domain>
Nov 16 18:21:59 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-408569235',display_name='tempest-SnapshotDataIntegrityTests-server-408569235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-408569235',id=45,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOcM9oUP53yA60pnkVXuYbvv6k+GSc14Hf7oIZBXy+VoDNHQTlBapUQBoYPADfKQfYXuI6Fnpf++TWYJ2gPoQ0P0H8Q6qMgtRopEUDlcbwY6h5HZf5rKR/g9GTRaEvlrQ==',key_name='tempest-keypair-1706832352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a214817c58484919adc5dd06fc588977',ramdisk_id='',reservation_id='r-a0j5d93z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-904336717',owner_user_name='tempest-SnapshotDataIntegrityTests-904336717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:21:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccae5b59579145658e1e5170763158cb',uuid=952e341a-db9a-45e6-b3a3-6e97ab8ae524,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Converting VIF {"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d6:05,bridge_name='br-int',has_traffic_filtering=True,id=9f2f4b77-ea5f-44cd-a9e6-a48449c85641,network=Network(2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f2f4b77-ea') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG os_vif [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d6:05,bridge_name='br-int',has_traffic_filtering=True,id=9f2f4b77-ea5f-44cd-a9e6-a48449c85641,network=Network(2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f2f4b77-ea') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b781876-8921-5f2f-913b-02bd814c0805', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f2f4b77-ea, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f2f4b77-ea, col_values=(('qos', UUID('9e39945f-fc12-41cb-b430-7ca8864249c7')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f2f4b77-ea, col_values=(('external_ids', {'iface-id': '9f2f4b77-ea5f-44cd-a9e6-a48449c85641', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:d6:05', 'vm-uuid': '952e341a-db9a-45e6-b3a3-6e97ab8ae524'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:21:59 user nova-compute[75342]: INFO os_vif [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d6:05,bridge_name='br-int',has_traffic_filtering=True,id=9f2f4b77-ea5f-44cd-a9e6-a48449c85641,network=Network(2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f2f4b77-ea')
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No VIF found with MAC fa:16:3e:a1:d6:05, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.network.neutron [req-59837df9-5951-4339-93b1-b7645c20070f req-614e3581-e77c-42fa-be0c-7dd089ee2a05 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updated VIF entry in instance network info cache for port 9f2f4b77-ea5f-44cd-a9e6-a48449c85641. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG nova.network.neutron [req-59837df9-5951-4339-93b1-b7645c20070f req-614e3581-e77c-42fa-be0c-7dd089ee2a05 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updating instance_info_cache with network_info: [{"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:21:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-59837df9-5951-4339-93b1-b7645c20070f req-614e3581-e77c-42fa-be0c-7dd089ee2a05 service nova] Releasing lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:22:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-d353f76e-17b3-440a-b914-f8a99e500ead req-aed36744-51bf-4b53-a766-9c204165af5e service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Received event network-vif-plugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:22:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d353f76e-17b3-440a-b914-f8a99e500ead req-aed36744-51bf-4b53-a766-9c204165af5e service nova] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:22:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d353f76e-17b3-440a-b914-f8a99e500ead req-aed36744-51bf-4b53-a766-9c204165af5e service nova] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:22:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d353f76e-17b3-440a-b914-f8a99e500ead req-aed36744-51bf-4b53-a766-9c204165af5e service nova] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-d353f76e-17b3-440a-b914-f8a99e500ead req-aed36744-51bf-4b53-a766-9c204165af5e service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] No waiting events found dispatching network-vif-plugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:22:00 user nova-compute[75342]: WARNING nova.compute.manager [req-d353f76e-17b3-440a-b914-f8a99e500ead req-aed36744-51bf-4b53-a766-9c204165af5e service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Received unexpected event network-vif-plugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 for instance with vm_state building and task_state spawning.
Nov 16 18:22:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:22:02 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Instance spawned successfully.
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:22:02 user nova-compute[75342]: INFO nova.compute.manager [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-84c7b36c-f0f7-4bcb-ad67-7d23ff524f24 req-88fa9e2e-9123-43b1-b4e0-2c449d4bcb4f service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Received event network-vif-plugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-84c7b36c-f0f7-4bcb-ad67-7d23ff524f24 req-88fa9e2e-9123-43b1-b4e0-2c449d4bcb4f service nova] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-84c7b36c-f0f7-4bcb-ad67-7d23ff524f24 req-88fa9e2e-9123-43b1-b4e0-2c449d4bcb4f service nova] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-84c7b36c-f0f7-4bcb-ad67-7d23ff524f24 req-88fa9e2e-9123-43b1-b4e0-2c449d4bcb4f service nova] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-84c7b36c-f0f7-4bcb-ad67-7d23ff524f24 req-88fa9e2e-9123-43b1-b4e0-2c449d4bcb4f service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] No waiting events found dispatching network-vif-plugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:22:02 user nova-compute[75342]: WARNING nova.compute.manager [req-84c7b36c-f0f7-4bcb-ad67-7d23ff524f24 req-88fa9e2e-9123-43b1-b4e0-2c449d4bcb4f service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Received unexpected event network-vif-plugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 for instance with vm_state building and task_state spawning.
Nov 16 18:22:02 user nova-compute[75342]: INFO nova.compute.manager [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Took 6.19 seconds to build instance.
Nov 16 18:22:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-74ed4525-36e4-41d0-be15-4b12b643f757 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.298s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:02 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:22:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-0d6d4806-88b1-41b2-9502-3e93415c55b7 req-166331cd-7771-4fd5-b764-e54df43836d3 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received event network-changed-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-0d6d4806-88b1-41b2-9502-3e93415c55b7 req-166331cd-7771-4fd5-b764-e54df43836d3 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Refreshing instance network info cache due to event network-changed-60e68362-04fe-4c9a-8c48-2d065c5b6fea. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0d6d4806-88b1-41b2-9502-3e93415c55b7 req-166331cd-7771-4fd5-b764-e54df43836d3 service nova] Acquiring lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0d6d4806-88b1-41b2-9502-3e93415c55b7 req-166331cd-7771-4fd5-b764-e54df43836d3 service nova] Acquired lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG nova.network.neutron [req-0d6d4806-88b1-41b2-9502-3e93415c55b7 req-166331cd-7771-4fd5-b764-e54df43836d3 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Refreshing network info cache for port 60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "bd8e6fae-5355-449f-a552-e90f74d189d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:17 user nova-compute[75342]: INFO nova.compute.manager [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Terminating instance
Nov 16 18:22:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-4aff39e7-4405-4868-966e-1551e5c53ee1 req-652a3184-8f15-4112-9d6c-ec106bb4b2d0 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received event network-vif-unplugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4aff39e7-4405-4868-966e-1551e5c53ee1 req-652a3184-8f15-4112-9d6c-ec106bb4b2d0 service nova] Acquiring lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4aff39e7-4405-4868-966e-1551e5c53ee1 req-652a3184-8f15-4112-9d6c-ec106bb4b2d0 service nova] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4aff39e7-4405-4868-966e-1551e5c53ee1 req-652a3184-8f15-4112-9d6c-ec106bb4b2d0 service nova] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-4aff39e7-4405-4868-966e-1551e5c53ee1 req-652a3184-8f15-4112-9d6c-ec106bb4b2d0 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] No waiting events found dispatching network-vif-unplugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-4aff39e7-4405-4868-966e-1551e5c53ee1 req-652a3184-8f15-4112-9d6c-ec106bb4b2d0 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received event network-vif-unplugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG nova.network.neutron [req-0d6d4806-88b1-41b2-9502-3e93415c55b7 req-166331cd-7771-4fd5-b764-e54df43836d3 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Updated VIF entry in instance network info cache for port 60e68362-04fe-4c9a-8c48-2d065c5b6fea. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG nova.network.neutron [req-0d6d4806-88b1-41b2-9502-3e93415c55b7 req-166331cd-7771-4fd5-b764-e54df43836d3 service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Updating instance_info_cache with network_info: [{"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:22:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0d6d4806-88b1-41b2-9502-3e93415c55b7 req-166331cd-7771-4fd5-b764-e54df43836d3 service nova] Releasing lock "refresh_cache-bd8e6fae-5355-449f-a552-e90f74d189d7" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:22:18 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Instance destroyed successfully.
Nov 16 18:22:18 user nova-compute[75342]: DEBUG nova.objects.instance [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lazy-loading 'resources' on Instance uuid bd8e6fae-5355-449f-a552-e90f74d189d7 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1768646067',display_name='tempest-TestVolumeBootPattern-server-1768646067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1768646067',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxsC14B7FXvV2fSoMtlJDAqdPeFWveN/Z0Ifom/f6iLWm22eKeX4OVWWNojR/qqP5b5ZDw4QQNhLxzsgEQuPgfcqpGQNglCOOs11ACZVIFU1+eY4bhyAYc4WrWEkoqGQ==',key_name='tempest-TestVolumeBootPattern-2105905581',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d44dce2b444ef386b47927d5c70c8e',ramdisk_id='',reservation_id='r-4ayeigdw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-312873750',owner_user_name='tempest-TestVolumeBootPattern-312873750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:17:44Z,user_data=None,user_id='062cd6d338014493be6c40701d2a735b',uuid=bd8e6fae-5355-449f-a552-e90f74d189d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converting VIF {"id": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "address": "fa:16:3e:a9:30:ef", "network": {"id": "98de6887-4989-4502-9a48-4c0afd48a067", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1212729672-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d44dce2b444ef386b47927d5c70c8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e68362-04", "ovs_interfaceid": "60e68362-04fe-4c9a-8c48-2d065c5b6fea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:30:ef,bridge_name='br-int',has_traffic_filtering=True,id=60e68362-04fe-4c9a-8c48-2d065c5b6fea,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60e68362-04') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_vif [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:30:ef,bridge_name='br-int',has_traffic_filtering=True,id=60e68362-04fe-4c9a-8c48-2d065c5b6fea,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60e68362-04') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60e68362-04, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b8dd958-33ff-4f02-b4cf-338c6698a97c) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:22:18 user nova-compute[75342]: INFO os_vif [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:30:ef,bridge_name='br-int',has_traffic_filtering=True,id=60e68362-04fe-4c9a-8c48-2d065c5b6fea,network=Network(98de6887-4989-4502-9a48-4c0afd48a067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60e68362-04')
Nov 16 18:22:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SAElFIVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:22:18 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59d7ca2-544a-4afe-81f7-5fb707cae541]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:22:18 user nova-compute[75342]: No targets found.
Nov 16 18:22:18 user nova-compute[75342]: iSNS:
Nov 16 18:22:18 user nova-compute[75342]: No targets found.
Nov 16 18:22:18 user nova-compute[75342]: STATIC:
Nov 16 18:22:18 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da
Nov 16 18:22:18 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:22:18 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:22:18 user nova-compute[75342]: FIRMWARE:
Nov 16 18:22:18 user nova-compute[75342]: No targets found.
Nov 16 18:22:18 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:22:18 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:22:18 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36a1a02-0061-4e6f-b7c4-f87292c2fce8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fa03a2-fc42-4a06-ab74-fc67fad0c9d7]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:22:18 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da (non-flash)
Nov 16 18:22:18 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a45d16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da'): ({'sdc'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Removing single pathed devices sdc {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fecf30-0eaf-4ade-b81c-4b4d7585d169]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df9af31-ab78-4044-9cf6-48b551309229]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Flushing IO for device /dev/sdc {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5018e01-185e-4c8a-8ac1-553870e56d97]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[707c93b6-4394-4774-9065-e7f80a660ea1]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_db1127f6', '/dev/disk/by-id/scsi-26566343435383662', '/dev/disk/by-id/scsi-1SCST_BIOdb1127f6-ef44586bdc18f501') {{(pid=85570) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a34ad11-aced-4de3-a4bc-0ad8e9e30bae]: (4, None) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b4a015-d730-4ae8-9320-69ee2895a550]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[206ad58f-0f40-4367-b5d4-ea3b9ce7ba61]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260]
Nov 16 18:22:18 user nova-compute[75342]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da, portal: 172.16.0.220,3260] successful.
Nov 16 18:22:18 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1b7789f-96b0-4cc3-9042-ad3199d965da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80df8f6-64ed-41d6-963a-8a342f2272d1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] <== disconnect_volume: return (288ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:22:18 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Deleting instance files /opt/stack/data/nova/instances/bd8e6fae-5355-449f-a552-e90f74d189d7_del
Nov 16 18:22:18 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Deletion of /opt/stack/data/nova/instances/bd8e6fae-5355-449f-a552-e90f74d189d7_del complete
Nov 16 18:22:18 user nova-compute[75342]: INFO nova.compute.manager [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 16 18:22:18 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:22:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:19 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:22:19 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Took 0.46 seconds to deallocate network for instance.
Nov 16 18:22:19 user nova-compute[75342]: INFO nova.compute.manager [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Took 0.71 seconds to detach 1 volumes for instance.
Nov 16 18:22:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:22:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:22:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-39592256-5ed8-49c8-887a-43128f819ec7 req-9a2fc7d3-34c7-46a7-be99-f5cbdbd98e4a service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received event network-vif-plugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:22:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-39592256-5ed8-49c8-887a-43128f819ec7 req-9a2fc7d3-34c7-46a7-be99-f5cbdbd98e4a service nova] Acquiring lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:22:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-39592256-5ed8-49c8-887a-43128f819ec7 req-9a2fc7d3-34c7-46a7-be99-f5cbdbd98e4a service nova] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:22:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-39592256-5ed8-49c8-887a-43128f819ec7 req-9a2fc7d3-34c7-46a7-be99-f5cbdbd98e4a service nova] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-39592256-5ed8-49c8-887a-43128f819ec7 req-9a2fc7d3-34c7-46a7-be99-f5cbdbd98e4a service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] No waiting events found dispatching network-vif-plugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:22:19 user nova-compute[75342]: WARNING nova.compute.manager [req-39592256-5ed8-49c8-887a-43128f819ec7 req-9a2fc7d3-34c7-46a7-be99-f5cbdbd98e4a service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received unexpected event network-vif-plugged-60e68362-04fe-4c9a-8c48-2d065c5b6fea for instance with vm_state deleted and task_state None.
Nov 16 18:22:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-39592256-5ed8-49c8-887a-43128f819ec7 req-9a2fc7d3-34c7-46a7-be99-f5cbdbd98e4a service nova] [instance: bd8e6fae-5355-449f-a552-e90f74d189d7] Received event network-vif-deleted-60e68362-04fe-4c9a-8c48-2d065c5b6fea {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:22:20 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:22:20 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:22:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:20 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Deleted allocations for instance bd8e6fae-5355-449f-a552-e90f74d189d7
Nov 16 18:22:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2794249e-f8ac-4144-a0f5-378db1a5fbbf tempest-TestVolumeBootPattern-312873750 tempest-TestVolumeBootPattern-312873750-project-member] Lock "bd8e6fae-5355-449f-a552-e90f74d189d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.791s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:22:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:22:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:22:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:22:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:48 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-b99c37f2-e01e-4053-ab92-0510f3acecc3 req-adf8c749-217d-4c39-a32f-14a9f8a3e287 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-changed-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-b99c37f2-e01e-4053-ab92-0510f3acecc3 req-adf8c749-217d-4c39-a32f-14a9f8a3e287 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Refreshing instance network info cache due to event network-changed-ddb1369d-547f-46d2-b7b2-feb2743ceef1. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b99c37f2-e01e-4053-ab92-0510f3acecc3 req-adf8c749-217d-4c39-a32f-14a9f8a3e287 service nova] Acquiring lock "refresh_cache-6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b99c37f2-e01e-4053-ab92-0510f3acecc3 req-adf8c749-217d-4c39-a32f-14a9f8a3e287 service nova] Acquired lock "refresh_cache-6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG nova.network.neutron [req-b99c37f2-e01e-4053-ab92-0510f3acecc3 req-adf8c749-217d-4c39-a32f-14a9f8a3e287 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Refreshing network info cache for port ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG nova.objects.instance [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lazy-loading 'flavor' on Instance uuid 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:22:49 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Ignoring supplied device name: /dev/vdb
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:22:49 user nova-compute[75342]: INFO nova.compute.manager [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Attaching volume ad516be9-5a91-47da-995f-e62237da85fb to /dev/vdb
Nov 16 18:22:49 user nova-compute[75342]: DEBUG nova.network.neutron [req-b99c37f2-e01e-4053-ab92-0510f3acecc3 req-adf8c749-217d-4c39-a32f-14a9f8a3e287 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Updated VIF entry in instance network info cache for port ddb1369d-547f-46d2-b7b2-feb2743ceef1. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG nova.network.neutron [req-b99c37f2-e01e-4053-ab92-0510f3acecc3 req-adf8c749-217d-4c39-a32f-14a9f8a3e287 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Updating instance_info_cache with network_info: [{"id": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "address": "fa:16:3e:f8:df:e7", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb1369d-54", "ovs_interfaceid": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b99c37f2-e01e-4053-ab92-0510f3acecc3 req-adf8c749-217d-4c39-a32f-14a9f8a3e287 service nova] Releasing lock "refresh_cache-6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG os_brick.utils [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eae255b-8d20-4de1-9970-5bf010e51a9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fed8048-de6a-424a-acef-64a2bd36f1e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ded8558-5120-40a6-9166-c7e7ecdbb665]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aad30d7-f812-44ce-ae5d-dd317e0aa1ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:22:49 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:22:49 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ac2558-70cf-41eb-8cc4-9f3ee09a6bbd]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG os_brick.utils [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:22:49 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Updating existing volume attachment record: 5a0ab397-30a8-4d77-ba1c-60f49170e0d6 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:22:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:22:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:22:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:22:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:22:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:22:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obvldKVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:22:54 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:22:54 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:22:54 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5c1829-abab-47db-88e7-069470d06803]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:22:54 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14b1199-9c22-4b54-a788-04573e1804da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb] added
Nov 16 18:22:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b04c4-25bf-4caa-b808-ba87c283659b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[286db84b-e876-4b72-9223-994b2d3bc6ac]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v obvldKVE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v obvldKVE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11ee5a8-e3cb-49b6-9551-089be73ff46f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'obvldKVE'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51d9142-a86d-40c5-adea-0d206fb3f21e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bd31a1-196f-4afd-af0e-952ae99c039e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:22:54 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:22:54 user nova-compute[75342]:  {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:22:54 user nova-compute[75342]: WARNING os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 18:22:54 user nova-compute[75342]: 
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a6eb37-e6b1-4fb1-80f6-7c01dfa5cb34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb, portal: 172.16.0.220,3260]
Nov 16 18:22:54 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb, portal: 172.16.0.220,3260] successful.
Nov 16 18:22:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1328d93-6fb6-4577-b21e-57ffe08035a4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce54b0ea-c46b-47de-b07d-0c6f8453fe51]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)
Nov 16 18:22:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)
Nov 16 18:22:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a9d2c9-c486-4d70-aa1a-7a3523900f3b]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obvldKVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26266343365313564', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266343365313564', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG nova.objects.instance [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lazy-loading 'flavor' on Instance uuid 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:22:55 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:22:55 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:22:55 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:22:55 user nova-compute[75342]:   <serial>ad516be9-5a91-47da-995f-e62237da85fb</serial>
Nov 16 18:22:55 user nova-compute[75342]: </disk>
Nov 16 18:22:55 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] No VIF found with MAC fa:16:3e:f8:df:e7, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:22:56 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:22:56 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8283MB free_disk=25.146194458007812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-20aa5bc5-14e1-46a3-996d-2420ca4e9834 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.190s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 5edd2a74-89b9-4163-b452-d491be30059b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:22:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:22:57 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:22:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:22:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:22:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:22:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:22:58 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:22:58 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:22:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:22:58 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updating instance_info_cache with network_info: [{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:22:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:22:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:22:58 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:22:58 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:22:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-1511ee6a-c55d-40cd-a82f-cfa29e87000e req-fd3aebe3-7f4a-405d-8199-3a894a8175ec service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received event network-changed-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-1511ee6a-c55d-40cd-a82f-cfa29e87000e req-fd3aebe3-7f4a-405d-8199-3a894a8175ec service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Refreshing instance network info cache due to event network-changed-81d7a65f-87b1-474c-877c-03f5dec5113c. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:23:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1511ee6a-c55d-40cd-a82f-cfa29e87000e req-fd3aebe3-7f4a-405d-8199-3a894a8175ec service nova] Acquiring lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:23:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1511ee6a-c55d-40cd-a82f-cfa29e87000e req-fd3aebe3-7f4a-405d-8199-3a894a8175ec service nova] Acquired lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:23:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-1511ee6a-c55d-40cd-a82f-cfa29e87000e req-fd3aebe3-7f4a-405d-8199-3a894a8175ec service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Refreshing network info cache for port 81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG nova.objects.instance [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lazy-loading 'flavor' on Instance uuid 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:07 user nova-compute[75342]: INFO nova.compute.manager [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Attaching volume 3d77425b-6f97-47ce-baf6-56dcfb324b28 to /dev/vdb
Nov 16 18:23:07 user nova-compute[75342]: DEBUG os_brick.utils [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c98279-16f0-4947-9e6c-bf2408cfc1da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df579bf-06a9-48bb-8dcc-f7529f778f34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b523b408-7a23-4ee3-b5c0-75a44878235d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4b7761-6eae-4f86-9dd3-2c37c4f07eb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-1511ee6a-c55d-40cd-a82f-cfa29e87000e req-fd3aebe3-7f4a-405d-8199-3a894a8175ec service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updated VIF entry in instance network info cache for port 81d7a65f-87b1-474c-877c-03f5dec5113c. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-1511ee6a-c55d-40cd-a82f-cfa29e87000e req-fd3aebe3-7f4a-405d-8199-3a894a8175ec service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updating instance_info_cache with network_info: [{"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:23:07 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86fb620-8a3f-4e9b-afc7-8314b81a199c]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG os_brick.utils [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updating existing volume attachment record: 9b3a8803-2859-43b7-94bb-dda52f3acef2 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:23:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1511ee6a-c55d-40cd-a82f-cfa29e87000e req-fd3aebe3-7f4a-405d-8199-3a894a8175ec service nova] Releasing lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:23:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:10 user nova-compute[75342]: INFO nova.compute.manager [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Detaching volume ad516be9-5a91-47da-995f-e62237da85fb
Nov 16 18:23:10 user nova-compute[75342]: INFO nova.virt.block_device [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Attempting to driver detach volume ad516be9-5a91-47da-995f-e62237da85fb from mountpoint /dev/vdb
Nov 16 18:23:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Attempting to detach device vdb from instance 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:23:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:23:10 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:23:10 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:23:10 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:23:10 user nova-compute[75342]:   <serial>ad516be9-5a91-47da-995f-e62237da85fb</serial>
Nov 16 18:23:10 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:23:10 user nova-compute[75342]: </disk>
Nov 16 18:23:10 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:23:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Successfully detached device vdb from instance 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 from the persistent domain config.
Nov 16 18:23:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:23:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:23:10 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:23:10 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:23:10 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:23:10 user nova-compute[75342]:   <serial>ad516be9-5a91-47da-995f-e62237da85fb</serial>
Nov 16 18:23:10 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:23:10 user nova-compute[75342]: </disk>
Nov 16 18:23:10 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:23:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxafvBew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:12 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:12 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:12 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2f6e5d-aa25-477f-9fc7-d8910b8ce353]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:23:12 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[304384df-aafe-4703-8eed-09f83599c534]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28] added
Nov 16 18:23:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e62ba3-6150-4e06-a430-7ef434377c91]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[53579156-4b87-4a5e-bf13-8b67d5808fdc]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxafvBew {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxafvBew" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc85455a-795a-4ee8-b3aa-97924b0dc98d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FxafvBew'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a7b4c1-be44-4227-8c3b-5171cc17e09a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[486189a6-5715-415c-9602-6f719b37f998]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)
Nov 16 18:23:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)
Nov 16 18:23:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59a5214-e156-44d3-9791-6d5065a622fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28, portal: 172.16.0.220,3260]
Nov 16 18:23:12 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28, portal: 172.16.0.220,3260] successful.
Nov 16 18:23:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[62719f12-370c-493f-9596-f0c626b25af2]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a026e61-77cf-4144-9c1a-36b9c91e89b8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)
Nov 16 18:23:12 user nova-compute[75342]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)
Nov 16 18:23:12 user nova-compute[75342]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:12 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb886d-b697-4560-8b93-05d0cff3814a]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:23:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxafvBew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:23:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26635306638366564', 'path': '/dev/sdc'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635306638366564', 'path': '/dev/sdc'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:23:13 user nova-compute[75342]: DEBUG nova.objects.instance [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lazy-loading 'flavor' on Instance uuid 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:23:13 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:23:13 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:23:13 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:23:13 user nova-compute[75342]:   <serial>3d77425b-6f97-47ce-baf6-56dcfb324b28</serial>
Nov 16 18:23:13 user nova-compute[75342]: </disk>
Nov 16 18:23:13 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:23:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] No VIF found with MAC fa:16:3e:2a:89:a9, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:23:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45dbf714-06e9-4b44-bdfa-bcace5c18383 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.919s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:16 user nova-compute[75342]: INFO nova.compute.manager [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Detaching volume 3d77425b-6f97-47ce-baf6-56dcfb324b28
Nov 16 18:23:16 user nova-compute[75342]: INFO nova.virt.block_device [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Attempting to driver detach volume 3d77425b-6f97-47ce-baf6-56dcfb324b28 from mountpoint /dev/vdb
Nov 16 18:23:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Attempting to detach device vdb from instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:23:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:23:16 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:23:16 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:23:16 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:23:16 user nova-compute[75342]:   <serial>3d77425b-6f97-47ce-baf6-56dcfb324b28</serial>
Nov 16 18:23:16 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:23:16 user nova-compute[75342]: </disk>
Nov 16 18:23:16 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:23:16 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Successfully detached device vdb from instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 from the persistent domain config.
Nov 16 18:23:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:23:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:23:16 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:23:16 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:23:16 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:23:16 user nova-compute[75342]:   <serial>3d77425b-6f97-47ce-baf6-56dcfb324b28</serial>
Nov 16 18:23:16 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:23:16 user nova-compute[75342]: </disk>
Nov 16 18:23:16 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:23:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:23:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:26 user nova-compute[75342]: DEBUG nova.objects.instance [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'flavor' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:27 user nova-compute[75342]: INFO nova.compute.manager [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Attaching volume 883de896-bc61-4f55-aa19-abcc569d186d to /dev/vdb
Nov 16 18:23:27 user nova-compute[75342]: DEBUG os_brick.utils [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c440878-79e3-4076-8699-48dd78a514c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7af041c-7732-423b-a366-1f850de27177]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3435bbb-87a5-428b-b5b8-5306fe718b3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a7afde-6bfd-449c-8dcf-927274e8acf9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:23:27 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:23:27 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef9dca8-e1ad-48c9-8091-14b042c42fee]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG os_brick.utils [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:27 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updating existing volume attachment record: 5c9c23b7-3231-4f33-93ba-27e28e3917eb {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:23:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:31 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 is timed out.
Nov 16 18:23:31 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Successfully detached device vdb from instance 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 from the live domain config.
Nov 16 18:23:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obvldKVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:31 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23daa21-df98-45a6-a19b-c0705bb1d204]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:23:31 user nova-compute[75342]: No targets found.
Nov 16 18:23:31 user nova-compute[75342]: iSNS:
Nov 16 18:23:31 user nova-compute[75342]: No targets found.
Nov 16 18:23:31 user nova-compute[75342]: STATIC:
Nov 16 18:23:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28
Nov 16 18:23:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:23:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:23:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb
Nov 16 18:23:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:23:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:23:31 user nova-compute[75342]: FIRMWARE:
Nov 16 18:23:31 user nova-compute[75342]: No targets found.
Nov 16 18:23:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:23:31 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:23:31 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edd8e6f-f64c-4b83-8624-0c88cd4b44b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06ab7de-ee59-46ba-8ea4-e3498fe3e034]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)
Nov 16 18:23:31 user nova-compute[75342]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb (non-flash)
Nov 16 18:23:31 user nova-compute[75342]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a4561e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[01363285-70a8-47ba-b718-bca5fdaa9120]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a10285-695e-48d4-a5f4-f532436a3339]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8392d1-6ab6-4aa2-89cf-c787cd650cce]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d701f894-7251-4c7d-827a-f24ecd814caa]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce600e3a-0bf4-4b9d-b2d6-eff600d5853c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd0084f-1905-46ff-8930-ba989fb4e648]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb, portal: 172.16.0.220,3260]
Nov 16 18:23:31 user nova-compute[75342]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb, portal: 172.16.0.220,3260] successful.
Nov 16 18:23:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87075d9-ff44-4c76-94bf-a7e54dd29ab8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] <== disconnect_volume: return (309ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG nova.objects.instance [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lazy-loading 'flavor' on Instance uuid 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGqJVTAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:32 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:32 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:32 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d361fba-a2ea-44f2-8c73-ffce73aa789d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:23:32 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7b6af005-6921-4499-a271-afeb3292c33d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.713s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.554s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:32 user nova-compute[75342]: INFO nova.compute.manager [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Terminating instance
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e517c467-7391-4fe8-8dff-5bd7da64d55f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d] added
Nov 16 18:23:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16449cb-03a0-484f-8944-862aa5659dd5]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3d41aa-d99a-4ee8-85d1-9f8bd40a64b0]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fGqJVTAm {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fGqJVTAm" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d048fc-e212-4aab-9d0b-c8dd6cd257ce]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fGqJVTAm'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ae8440-9c01-4fef-9b96-d6a18a7773e8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[63748243-ea89-4f2c-9259-83c20b65ef10]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afbd8cf-de59-465a-a391-12b11e493d02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d, portal: 172.16.0.220,3260]
Nov 16 18:23:32 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d, portal: 172.16.0.220,3260] successful.
Nov 16 18:23:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a744f6-5eb6-4182-8a8e-ec95eda4823c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5953880e-785b-4add-9c9d-18afde67b6ef]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:32 user nova-compute[75342]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:32 user nova-compute[75342]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:32 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1798a775-5286-4516-9c61-0a6a05d7f94a]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-0bf426c7-1c4e-430f-9260-342e6de13002 req-77c4ed83-ef81-40f0-952a-e895939e8556 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-vif-unplugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0bf426c7-1c4e-430f-9260-342e6de13002 req-77c4ed83-ef81-40f0-952a-e895939e8556 service nova] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0bf426c7-1c4e-430f-9260-342e6de13002 req-77c4ed83-ef81-40f0-952a-e895939e8556 service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0bf426c7-1c4e-430f-9260-342e6de13002 req-77c4ed83-ef81-40f0-952a-e895939e8556 service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-0bf426c7-1c4e-430f-9260-342e6de13002 req-77c4ed83-ef81-40f0-952a-e895939e8556 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] No waiting events found dispatching network-vif-unplugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG nova.compute.manager [req-0bf426c7-1c4e-430f-9260-342e6de13002 req-77c4ed83-ef81-40f0-952a-e895939e8556 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-vif-unplugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Instance destroyed successfully.
Nov 16 18:23:33 user nova-compute[75342]: DEBUG nova.objects.instance [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lazy-loading 'resources' on Instance uuid 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1225174140',display_name='tempest-VolumesSnapshotTestJSON-instance-1225174140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1225174140',id=42,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQMJI2FM8Gqw7dIn9/1hLI7gFICP4VfC1b78zmxSe0XBX7r0/TbdCxOlfnXg9w/IKok87VkFCwIoK5bALfE6ewIo2ioe+MAHFzkgk3xgKv7YOOPZmJT7rBCHxmyGs9e8A==',key_name='tempest-keypair-509822917',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afab8ca8fb0e4810aff37187498d3855',ramdisk_id='',reservation_id='r-uyzstzjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-31047705',owner_user_name='tempest-VolumesSnapshotTestJSON-31047705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48aea12e1e7c40f69b90ce451a9bf745',uuid=6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "address": "fa:16:3e:f8:df:e7", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb1369d-54", "ovs_interfaceid": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converting VIF {"id": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "address": "fa:16:3e:f8:df:e7", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb1369d-54", "ovs_interfaceid": "ddb1369d-547f-46d2-b7b2-feb2743ceef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:e7,bridge_name='br-int',has_traffic_filtering=True,id=ddb1369d-547f-46d2-b7b2-feb2743ceef1,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb1369d-54') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_vif [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:e7,bridge_name='br-int',has_traffic_filtering=True,id=ddb1369d-547f-46d2-b7b2-feb2743ceef1,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb1369d-54') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddb1369d-54, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97a4e8b7-d299-48de-9253-80edb2767ef1) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: INFO os_vif [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:e7,bridge_name='br-int',has_traffic_filtering=True,id=ddb1369d-547f-46d2-b7b2-feb2743ceef1,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb1369d-54')
Nov 16 18:23:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obvldKVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:33 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGqJVTAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23563313030353464', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563313030353464', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.467s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG nova.objects.instance [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'flavor' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e694e2-7a38-4b48-a411-f79f7c0d6dbe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:23:33 user nova-compute[75342]: No targets found.
Nov 16 18:23:33 user nova-compute[75342]: iSNS:
Nov 16 18:23:33 user nova-compute[75342]: No targets found.
Nov 16 18:23:33 user nova-compute[75342]: STATIC:
Nov 16 18:23:33 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28
Nov 16 18:23:33 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:23:33 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:23:33 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d
Nov 16 18:23:33 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:23:33 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:23:33 user nova-compute[75342]: FIRMWARE:
Nov 16 18:23:33 user nova-compute[75342]: No targets found.
Nov 16 18:23:33 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:23:33 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:23:33 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad516be9-5a91-47da-995f-e62237da85fb', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:23:33 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:23:33 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:23:33 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:23:33 user nova-compute[75342]:   <serial>883de896-bc61-4f55-aa19-abcc569d186d</serial>
Nov 16 18:23:33 user nova-compute[75342]: </disk>
Nov 16 18:23:33 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde4e3ec-99e6-4a94-b035-d4125d2a7c77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fd4e5a-763f-4ef8-9b13-5942d94552bb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:33 user nova-compute[75342]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:33 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:33 user nova-compute[75342]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:33 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6d01b9f30>, {}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Disconnecting from: [] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] <== disconnect_volume: return (554ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:23:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Deleting instance files /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8_del
Nov 16 18:23:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Deletion of /opt/stack/data/nova/instances/6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8_del complete
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:33 user nova-compute[75342]: INFO nova.compute.manager [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 16 18:23:33 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:23:33 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:23:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] No VIF found with MAC fa:16:3e:4e:b2:a7, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:23:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-fc430363-038f-4b25-91e7-16358b4a02e7 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.235s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] No waiting events found dispatching network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:34 user nova-compute[75342]: WARNING nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received unexpected event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 for instance with vm_state active and task_state deleting.
Nov 16 18:23:34 user nova-compute[75342]: DEBUG nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] No waiting events found dispatching network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:35 user nova-compute[75342]: WARNING nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received unexpected event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 for instance with vm_state active and task_state deleting.
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] No waiting events found dispatching network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:35 user nova-compute[75342]: WARNING nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received unexpected event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 for instance with vm_state active and task_state deleting.
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-vif-unplugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] No waiting events found dispatching network-vif-unplugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-vif-unplugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Acquiring lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] No waiting events found dispatching network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:35 user nova-compute[75342]: WARNING nova.compute.manager [req-f1290add-2aac-4e7f-8847-96a51aefabc6 req-67773a93-ce0f-4616-b9a7-4b4ccbe3c7af service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received unexpected event network-vif-plugged-ddb1369d-547f-46d2-b7b2-feb2743ceef1 for instance with vm_state active and task_state deleting.
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-b4c162f5-7812-424b-b841-e887ba4f68c0 req-ff1840c3-456d-4b94-9421-6c12563d6664 service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Received event network-changed-c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.compute.manager [req-b4c162f5-7812-424b-b841-e887ba4f68c0 req-ff1840c3-456d-4b94-9421-6c12563d6664 service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Refreshing instance network info cache due to event network-changed-c3ba5522-4a54-4d69-838c-1ee676262ef1. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b4c162f5-7812-424b-b841-e887ba4f68c0 req-ff1840c3-456d-4b94-9421-6c12563d6664 service nova] Acquiring lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b4c162f5-7812-424b-b841-e887ba4f68c0 req-ff1840c3-456d-4b94-9421-6c12563d6664 service nova] Acquired lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.network.neutron [req-b4c162f5-7812-424b-b841-e887ba4f68c0 req-ff1840c3-456d-4b94-9421-6c12563d6664 service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Refreshing network info cache for port c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:23:35 user nova-compute[75342]: INFO nova.compute.manager [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Rescuing
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquired lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.network.neutron [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:23:35 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Took 1.63 seconds to deallocate network for instance.
Nov 16 18:23:35 user nova-compute[75342]: WARNING nova.volume.cinder [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Attachment 5a0ab397-30a8-4d77-ba1c-60f49170e0d6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5a0ab397-30a8-4d77-ba1c-60f49170e0d6. (HTTP 404) (Request-ID: req-047774b7-6279-4509-94e0-f4766ddbb224)
Nov 16 18:23:35 user nova-compute[75342]: INFO nova.compute.manager [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Took 0.02 seconds to detach 1 volumes for instance.
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.network.neutron [req-b4c162f5-7812-424b-b841-e887ba4f68c0 req-ff1840c3-456d-4b94-9421-6c12563d6664 service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Updated VIF entry in instance network info cache for port c3ba5522-4a54-4d69-838c-1ee676262ef1. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.network.neutron [req-b4c162f5-7812-424b-b841-e887ba4f68c0 req-ff1840c3-456d-4b94-9421-6c12563d6664 service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Updating instance_info_cache with network_info: [{"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.network.neutron [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updating instance_info_cache with network_info: [{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Releasing lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b4c162f5-7812-424b-b841-e887ba4f68c0 req-ff1840c3-456d-4b94-9421-6c12563d6664 service nova] Releasing lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:35 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Deleted allocations for instance 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8
Nov 16 18:23:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ab9dfccd-8d4c-4457-b93d-723c408a5b66 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.614s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Instance destroyed successfully.
Nov 16 18:23:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Attempting a stable device rescue
Nov 16 18:23:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75342) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 18:23:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Instance directory exists: not creating {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 18:23:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Creating image(s)
Nov 16 18:23:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "/opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "/opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "/opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:36 user nova-compute[75342]: DEBUG nova.objects.instance [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "d357b24bf58349ed5b1337ea48ea139e205ad616" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "d357b24bf58349ed5b1337ea48ea139e205ad616" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:36 user nova-compute[75342]: DEBUG nova.objects.instance [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'flavor' on Instance uuid f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:36 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616.part --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:37 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 is timed out.
Nov 16 18:23:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] [instance: 6298fa8a-1bf1-4bf5-9cf3-c6300d6345a8] Received event network-vif-deleted-ddb1369d-547f-46d2-b7b2-feb2743ceef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-unplugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-unplugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:37 user nova-compute[75342]: WARNING nova.compute.manager [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received unexpected event network-vif-unplugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with vm_state active and task_state rescuing.
Nov 16 18:23:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG nova.compute.manager [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:37 user nova-compute[75342]: WARNING nova.compute.manager [req-e35f8824-881b-44d9-94b2-76518feb3d8a req-a519aa0e-b998-43eb-8b2a-9e4d75309ee1 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received unexpected event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with vm_state active and task_state rescuing.
Nov 16 18:23:37 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Successfully detached device vdb from instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 from the live domain config.
Nov 16 18:23:37 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxafvBew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:37 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:37 user nova-compute[75342]: INFO nova.compute.manager [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Attaching volume 0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb to /dev/vdb
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e73d13b-5d91-4b60-bce9-8efd3d285629]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:23:37 user nova-compute[75342]: No targets found.
Nov 16 18:23:37 user nova-compute[75342]: iSNS:
Nov 16 18:23:37 user nova-compute[75342]: No targets found.
Nov 16 18:23:37 user nova-compute[75342]: STATIC:
Nov 16 18:23:37 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28
Nov 16 18:23:37 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:23:37 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:23:37 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d
Nov 16 18:23:37 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:23:37 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:23:37 user nova-compute[75342]: FIRMWARE:
Nov 16 18:23:37 user nova-compute[75342]: No targets found.
Nov 16 18:23:37 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:23:37 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:23:37 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b9ecd6-b765-4281-94ad-f239e692a8cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f57027f-f855-4c9b-83c8-4412c3d93a20]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:37 user nova-compute[75342]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:37 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 (non-flash)
Nov 16 18:23:37 user nova-compute[75342]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:37 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c83ca8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28'): ({'sdc'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Removing single pathed devices sdc {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.utils [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd9db4c-25b9-4352-831b-6a9d2a62c18a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0d3f47-547e-4d76-93ff-0897ac020cb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f314221a-f587-4a2a-bcd0-d88a0c286310]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Flushing IO for device /dev/sdc {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:23:37 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG nova.virt.images [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] e958507a-6fca-4eb5-b813-3d96b3528348 was qcow2, converting to raw {{(pid=75342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616.part /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616.converted {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0d0afe-d0e8-4c07-8cc8-c0af9670591e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbf5b68-7212-4f5a-ab2d-14185887c788]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[af013e32-c6cc-4b25-9414-620ed2ebd6da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0a8adf-6764-45a6-9c33-4b92962b889e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad070da-4b71-45ba-a7d1-823245c65658]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:23:38 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[992713bd-0e5c-4c69-8963-0b280378d5e1]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.utils [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] <== get_connector_properties: return (244ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Updating existing volume attachment record: 652252b7-1ded-4e9b-b8f5-b4759d11973e {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e1eb04-6448-4823-9c39-b8b144b6dead]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.121s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b84a12c-2d3a-4fe0-b004-cff1495aa324]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28, portal: 172.16.0.220,3260]
Nov 16 18:23:38 user nova-compute[75342]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28, portal: 172.16.0.220,3260] successful.
Nov 16 18:23:38 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d77425b-6f97-47ce-baf6-56dcfb324b28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ad53ef-d156-4e74-8f0d-439c4907760b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] <== disconnect_volume: return (480ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616.part /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616.converted" returned: 0 in 0.828s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:38 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616.converted --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "d357b24bf58349ed5b1337ea48ea139e205ad616" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.442s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "d357b24bf58349ed5b1337ea48ea139e205ad616" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "d357b24bf58349ed5b1337ea48ea139e205ad616" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616 --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616,backing_fmt=raw /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.rescue {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lazy-loading 'flavor' on Instance uuid 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616,backing_fmt=raw /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.rescue" returned: 0 in 0.062s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "d357b24bf58349ed5b1337ea48ea139e205ad616" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'migration_context' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.objects.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Object Instance<5edd2a74-89b9-4163-b452-d491be30059b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Start _get_guest_xml network_info=[{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "vif_mac": "fa:16:3e:4e:b2:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e958507a-6fca-4eb5-b813-3d96b3528348', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5c9c23b7-3231-4f33-93ba-27e28e3917eb', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGqJVTAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5edd2a74-89b9-4163-b452-d491be30059b', 'attached_at': '', 'detached_at': '', 'volume_id': '883de896-bc61-4f55-aa19-abcc569d186d', 'serial': '883de896-bc61-4f55-aa19-abcc569d186d'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'resources' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.objects.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Object Instance<5edd2a74-89b9-4163-b452-d491be30059b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'numa_topology' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.objects.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Object Instance<5edd2a74-89b9-4163-b452-d491be30059b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-01896191-7c18-40b1-9ef6-d637fe04b6a3 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.701s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:39 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:23:39 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.objects.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Object Instance<5edd2a74-89b9-4163-b452-d491be30059b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGqJVTAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:39 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:39 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:39 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cf198c-154a-4e9d-bfab-6d607e4eb3ca]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fGqJVTAm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 18:23:39 user nova-compute[75342]: node.name = iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d
Nov 16 18:23:39 user nova-compute[75342]: node.tpgt = -1
Nov 16 18:23:39 user nova-compute[75342]: node.startup = automatic
Nov 16 18:23:39 user nova-compute[75342]: node.leading_login = No
Nov 16 18:23:39 user nova-compute[75342]: iface.iscsi_ifacename = default
Nov 16 18:23:39 user nova-compute[75342]: iface.net_ifacename = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.ipaddress = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.prefix_len = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.hwaddress = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.transport_name = tcp
Nov 16 18:23:39 user nova-compute[75342]: iface.initiatorname = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.state = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.vlan_id = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.vlan_priority = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.vlan_state = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.iface_num = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.mtu = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.port = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.bootproto = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.subnet_mask = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.gateway = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.dhcp_alt_client_id = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.dhcp_dns = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.dhcp_learn_iqn = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.dhcp_vendor_id_state = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.dhcp_vendor_id = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.dhcp_slp_da = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.fragmentation = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.gratuitous_arp = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.incoming_forwarding = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.tos_state = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.tos = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.ttl = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.delayed_ack = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.tcp_nagle = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.tcp_wsf_state = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.tcp_wsf = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.tcp_timer_scale = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.tcp_timestamp = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.redirect = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.def_task_mgmt_timeout = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.header_digest = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.data_digest = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.immediate_data = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.initial_r2t = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.data_seq_inorder = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.data_pdu_inorder = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.erl = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.max_receive_data_len = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.first_burst_len = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.max_outstanding_r2t = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.max_burst_len = 0
Nov 16 18:23:39 user nova-compute[75342]: iface.chap_auth = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.bidi_chap = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.strict_login_compliance = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.discovery_auth = <empty>
Nov 16 18:23:39 user nova-compute[75342]: iface.discovery_logout = <empty>
Nov 16 18:23:39 user nova-compute[75342]: node.discovery_address = <empty>
Nov 16 18:23:39 user nova-compute[75342]: node.discovery_port = 0
Nov 16 18:23:39 user nova-compute[75342]: node.discovery_type = static
Nov 16 18:23:39 user nova-compute[75342]: node.session.initial_cmdsn = 0
Nov 16 18:23:39 user nova-compute[75342]: node.session.initial_login_retry_max = 8
Nov 16 18:23:39 user nova-compute[75342]: node.session.xmit_thread_priority = -20
Nov 16 18:23:39 user nova-compute[75342]: node.session.cmds_max = 128
Nov 16 18:23:39 user nova-compute[75342]: node.session.queue_depth = 32
Nov 16 18:23:39 user nova-compute[75342]: node.session.nr_sessions = 1
Nov 16 18:23:39 user nova-compute[75342]: node.session.auth.authmethod = CHAP
Nov 16 18:23:39 user nova-compute[75342]: node.session.auth.username = fGqJVTAm
Nov 16 18:23:39 user nova-compute[75342]: node.session.auth.password = ***
Nov 16 18:23:39 user nova-compute[75342]: node.session.auth.username_in = <empty>
Nov 16 18:23:39 user nova-compute[75342]: node.session.auth.password_in = <empty>
Nov 16 18:23:39 user nova-compute[75342]: node.session.auth.chap_algs = MD5
Nov 16 18:23:39 user nova-compute[75342]: node.session.timeo.replacement_timeout = 120
Nov 16 18:23:39 user nova-compute[75342]: node.session.err_timeo.abort_timeout = 15
Nov 16 18:23:39 user nova-compute[75342]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 18:23:39 user nova-compute[75342]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 18:23:39 user nova-compute[75342]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 18:23:39 user nova-compute[75342]: node.session.iscsi.FastAbort = Yes
Nov 16 18:23:39 user nova-compute[75342]: node.session.iscsi.InitialR2T = No
Nov 16 18:23:39 user nova-compute[75342]: node.session.iscsi.ImmediateData = Yes
Nov 16 18:23:39 user nova-compute[75342]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 18:23:39 user nova-compute[75342]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 18:23:39 user nova-compute[75342]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 18:23:39 user nova-compute[75342]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 18:23:39 user nova-compute[75342]: node.session.iscsi.MaxConnections = 1
Nov 16 18:23:39 user nova-compute[75342]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 18:23:39 user nova-compute[75342]: node.session.iscsi.ERL = 0
Nov 16 18:23:39 user nova-compute[75342]: node.session.scan = manual
Nov 16 18:23:39 user nova-compute[75342]: node.session.reopen_max = 0
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].address = 172.16.0.220
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].port = 3260
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].startup = manual
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].tcp.window_size = 524288
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].tcp.type_of_service = 0
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].timeo.logout_timeout = 15
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].timeo.login_timeout = 15
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].timeo.auth_timeout = 45
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].iscsi.DataDigest = None
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].iscsi.IFMarker = No
Nov 16 18:23:39 user nova-compute[75342]: node.conn[0].iscsi.OFMarker = No
Nov 16 18:23:39 user nova-compute[75342]: # END RECORD
Nov 16 18:23:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8068a2-bf9f-403d-92f2-2a0a437ac430]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.098s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa594db5-c36d-408b-ab2a-51f8edd11bc5]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fGqJVTAm {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fGqJVTAm" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b2a50c-a7ab-4d63-b6b1-a0f123524480]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fGqJVTAm'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5297363-d1cd-4044-99a4-a99bf979072e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2da34c1-4a76-48bc-8868-75b37b61c2b7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.221s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] HCTL ('33', '0', '0', 0) found on session 51 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ae6eb5-1340-45c9-8a35-d7bdb1ce6d23]: (4, ('0 0 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Searching for a device in session 51 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGqJVTAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.243s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] <== connect_volume: return (244ms) {'type': 'block', 'scsi_wwn': '23563313030353464', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563313030353464', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-314776098',display_name='tempest-ServerStableDeviceRescueTest-server-314776098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-314776098',id=41,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7slAhf1hcJjJc66r2jbRftcH0SKdrSI9SpP1eFgrtS94QNgsdg+iL6y93giftSWmkKIikiQ6vcEwKshKM/mm1C/N/UhH6LgQdD1fQLE7/00l44zE3dmSxSyV3Y4Zgtmg==',key_name='tempest-keypair-609421127',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:19:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='385c90950e3c4c7fbdcd36d6d9062685',ramdisk_id='',reservation_id='r-a7m9xowp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1240631636',owner_user_name='tempest-ServerStableDeviceRescueTest-1240631636-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36644656ce1f4f2e8a440d625a7285b3',uuid=5edd2a74-89b9-4163-b452-d491be30059b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "vif_mac": "fa:16:3e:4e:b2:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Converting VIF {"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "vif_mac": "fa:16:3e:4e:b2:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b2:a7,bridge_name='br-int',has_traffic_filtering=True,id=e421c3fa-c93c-486e-9658-a24ae8089927,network=Network(aad7e3f8-f970-4c25-b0f1-df64acead2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape421c3fa-c9') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.objects.instance [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'pci_devices' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.objects.base [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Object Instance<5edd2a74-89b9-4163-b452-d491be30059b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:23:39 user nova-compute[75342]:   <uuid>5edd2a74-89b9-4163-b452-d491be30059b</uuid>
Nov 16 18:23:39 user nova-compute[75342]:   <name>instance-00000029</name>
Nov 16 18:23:39 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:23:39 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:23:39 user nova-compute[75342]:   <metadata>
Nov 16 18:23:39 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:23:39 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:23:39 user nova-compute[75342]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-314776098</nova:name>
Nov 16 18:23:39 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:23:39</nova:creationTime>
Nov 16 18:23:39 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:23:39 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:23:39 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:23:39 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:23:39 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:23:39 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:23:39 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:23:39 user nova-compute[75342]:       <nova:owner>
Nov 16 18:23:39 user nova-compute[75342]:         <nova:user uuid="36644656ce1f4f2e8a440d625a7285b3">tempest-ServerStableDeviceRescueTest-1240631636-project-member</nova:user>
Nov 16 18:23:39 user nova-compute[75342]:         <nova:project uuid="385c90950e3c4c7fbdcd36d6d9062685">tempest-ServerStableDeviceRescueTest-1240631636</nova:project>
Nov 16 18:23:39 user nova-compute[75342]:       </nova:owner>
Nov 16 18:23:39 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:23:39 user nova-compute[75342]:       <nova:ports>
Nov 16 18:23:39 user nova-compute[75342]:         <nova:port uuid="e421c3fa-c93c-486e-9658-a24ae8089927">
Nov 16 18:23:39 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 18:23:39 user nova-compute[75342]:         </nova:port>
Nov 16 18:23:39 user nova-compute[75342]:       </nova:ports>
Nov 16 18:23:39 user nova-compute[75342]:     </nova:instance>
Nov 16 18:23:39 user nova-compute[75342]:   </metadata>
Nov 16 18:23:39 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:23:39 user nova-compute[75342]:     <system>
Nov 16 18:23:39 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:23:39 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:23:39 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:23:39 user nova-compute[75342]:       <entry name="serial">5edd2a74-89b9-4163-b452-d491be30059b</entry>
Nov 16 18:23:39 user nova-compute[75342]:       <entry name="uuid">5edd2a74-89b9-4163-b452-d491be30059b</entry>
Nov 16 18:23:39 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:23:39 user nova-compute[75342]:     </system>
Nov 16 18:23:39 user nova-compute[75342]:   </sysinfo>
Nov 16 18:23:39 user nova-compute[75342]:   <os>
Nov 16 18:23:39 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:23:39 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:23:39 user nova-compute[75342]:   </os>
Nov 16 18:23:39 user nova-compute[75342]:   <features>
Nov 16 18:23:39 user nova-compute[75342]:     <acpi/>
Nov 16 18:23:39 user nova-compute[75342]:     <apic/>
Nov 16 18:23:39 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:23:39 user nova-compute[75342]:   </features>
Nov 16 18:23:39 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:23:39 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:23:39 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:23:39 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:23:39 user nova-compute[75342]:   </clock>
Nov 16 18:23:39 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:23:39 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:23:39 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:23:39 user nova-compute[75342]:   </cpu>
Nov 16 18:23:39 user nova-compute[75342]:   <devices>
Nov 16 18:23:39 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:23:39 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:23:39 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk"/>
Nov 16 18:23:39 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:23:39 user nova-compute[75342]:     </disk>
Nov 16 18:23:39 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:23:39 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:23:39 user nova-compute[75342]:       <source dev="/dev/sdb"/>
Nov 16 18:23:39 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:23:39 user nova-compute[75342]:       <serial>883de896-bc61-4f55-aa19-abcc569d186d</serial>
Nov 16 18:23:39 user nova-compute[75342]:     </disk>
Nov 16 18:23:39 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:23:39 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:23:39 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.rescue"/>
Nov 16 18:23:39 user nova-compute[75342]:       <target dev="vdc" bus="virtio"/>
Nov 16 18:23:39 user nova-compute[75342]:       <boot order="1"/>
Nov 16 18:23:39 user nova-compute[75342]:     </disk>
Nov 16 18:23:39 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:23:39 user nova-compute[75342]:       <mac address="fa:16:3e:4e:b2:a7"/>
Nov 16 18:23:39 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:23:39 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:23:39 user nova-compute[75342]:       <target dev="tape421c3fa-c9"/>
Nov 16 18:23:39 user nova-compute[75342]:     </interface>
Nov 16 18:23:39 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:23:39 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/console.log" append="off"/>
Nov 16 18:23:39 user nova-compute[75342]:     </serial>
Nov 16 18:23:39 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:23:39 user nova-compute[75342]:     <video>
Nov 16 18:23:39 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:23:39 user nova-compute[75342]:     </video>
Nov 16 18:23:39 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:23:39 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:23:39 user nova-compute[75342]:     </rng>
Nov 16 18:23:39 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:23:39 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:23:39 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:23:39 user nova-compute[75342]:     </memballoon>
Nov 16 18:23:39 user nova-compute[75342]:   </devices>
Nov 16 18:23:39 user nova-compute[75342]: </domain>
Nov 16 18:23:39 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:23:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Instance destroyed successfully.
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] No VIF found with MAC fa:16:3e:4e:b2:a7, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:23:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-c7dcc5c8-b5cf-4b42-8186-691e2256e124 req-6cfdfbf0-b4fb-4ce1-8666-bd21f72c100d service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c7dcc5c8-b5cf-4b42-8186-691e2256e124 req-6cfdfbf0-b4fb-4ce1-8666-bd21f72c100d service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c7dcc5c8-b5cf-4b42-8186-691e2256e124 req-6cfdfbf0-b4fb-4ce1-8666-bd21f72c100d service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c7dcc5c8-b5cf-4b42-8186-691e2256e124 req-6cfdfbf0-b4fb-4ce1-8666-bd21f72c100d service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-c7dcc5c8-b5cf-4b42-8186-691e2256e124 req-6cfdfbf0-b4fb-4ce1-8666-bd21f72c100d service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:41 user nova-compute[75342]: WARNING nova.compute.manager [req-c7dcc5c8-b5cf-4b42-8186-691e2256e124 req-6cfdfbf0-b4fb-4ce1-8666-bd21f72c100d service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received unexpected event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with vm_state active and task_state rescuing.
Nov 16 18:23:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaXRFyPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:43 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:43 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:43 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacccb03-6738-4bca-af52-a924ab0e0905]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:23:43 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44509a1-6004-409d-91b5-b37ec1430a04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb] added
Nov 16 18:23:43 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b3483c-aae2-400d-8048-640ef51ec3e9]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fc7b69-9568-4d77-bf31-489a440e6b41]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaXRFyPI {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaXRFyPI" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2e4954-1a28-4758-8af8-1a01c1a1d6a6]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AaXRFyPI'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa3831b-5e14-4ba4-8285-352d9ba6eb09]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e1f8fe-edd7-4e71-96c7-f22051954d34]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:43 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:43 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8631196e-88ff-482c-a6af-9b599d5bca02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb, portal: 172.16.0.220,3260]
Nov 16 18:23:43 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb, portal: 172.16.0.220,3260] successful.
Nov 16 18:23:43 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f5195-d1b7-418a-89d3-7c4eb5bcbd49]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-d35bda9c-b941-4a31-af65-ca548475fc18 req-4fb807ed-2990-450b-9174-3930b03fb21b service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d35bda9c-b941-4a31-af65-ca548475fc18 req-4fb807ed-2990-450b-9174-3930b03fb21b service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d35bda9c-b941-4a31-af65-ca548475fc18 req-4fb807ed-2990-450b-9174-3930b03fb21b service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d35bda9c-b941-4a31-af65-ca548475fc18 req-4fb807ed-2990-450b-9174-3930b03fb21b service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG nova.compute.manager [req-d35bda9c-b941-4a31-af65-ca548475fc18 req-4fb807ed-2990-450b-9174-3930b03fb21b service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:43 user nova-compute[75342]: WARNING nova.compute.manager [req-d35bda9c-b941-4a31-af65-ca548475fc18 req-4fb807ed-2990-450b-9174-3930b03fb21b service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received unexpected event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with vm_state active and task_state rescuing.
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76d2a38-4e1f-4b76-90a5-d33c6210e1a7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:43 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:23:43 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:43 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:23:43 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[097427b6-e905-4b1f-838c-598d1ab06cad]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaXRFyPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG nova.compute.manager [None req-720efac7-ee45-48d7-9bbf-0e4b49dab5ff tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:23:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26133373361393336', 'path': '/dev/sdc'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133373361393336', 'path': '/dev/sdc'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:23:44 user nova-compute[75342]: DEBUG nova.objects.instance [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'flavor' on Instance uuid f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:23:44 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:23:44 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:23:44 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:23:44 user nova-compute[75342]:   <serial>0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb</serial>
Nov 16 18:23:44 user nova-compute[75342]: </disk>
Nov 16 18:23:44 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:23:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No VIF found with MAC fa:16:3e:07:34:2a, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:23:44 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-4f7a6b98-72fc-4a0f-bb78-e9557a60d070 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.062s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-b0f6e4bb-26cf-4f0b-a032-1a8eda03b6c7 req-c6f2b1e1-56b9-44d7-8682-bdcee70a6853 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Received event network-changed-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:47 user nova-compute[75342]: DEBUG nova.compute.manager [req-b0f6e4bb-26cf-4f0b-a032-1a8eda03b6c7 req-c6f2b1e1-56b9-44d7-8682-bdcee70a6853 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Refreshing instance network info cache due to event network-changed-9f2f4b77-ea5f-44cd-a9e6-a48449c85641. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:23:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b0f6e4bb-26cf-4f0b-a032-1a8eda03b6c7 req-c6f2b1e1-56b9-44d7-8682-bdcee70a6853 service nova] Acquiring lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:23:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b0f6e4bb-26cf-4f0b-a032-1a8eda03b6c7 req-c6f2b1e1-56b9-44d7-8682-bdcee70a6853 service nova] Acquired lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:23:47 user nova-compute[75342]: DEBUG nova.network.neutron [req-b0f6e4bb-26cf-4f0b-a032-1a8eda03b6c7 req-c6f2b1e1-56b9-44d7-8682-bdcee70a6853 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Refreshing network info cache for port 9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG nova.network.neutron [req-b0f6e4bb-26cf-4f0b-a032-1a8eda03b6c7 req-c6f2b1e1-56b9-44d7-8682-bdcee70a6853 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updated VIF entry in instance network info cache for port 9f2f4b77-ea5f-44cd-a9e6-a48449c85641. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG nova.network.neutron [req-b0f6e4bb-26cf-4f0b-a032-1a8eda03b6c7 req-c6f2b1e1-56b9-44d7-8682-bdcee70a6853 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updating instance_info_cache with network_info: [{"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b0f6e4bb-26cf-4f0b-a032-1a8eda03b6c7 req-c6f2b1e1-56b9-44d7-8682-bdcee70a6853 service nova] Releasing lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "62134cad-732d-4a9d-b385-68a4317d3a72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "62134cad-732d-4a9d-b385-68a4317d3a72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:23:48 user nova-compute[75342]: INFO nova.compute.claims [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Claim successful on node user
Nov 16 18:23:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG nova.network.neutron [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:23:49 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:23:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG nova.policy [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6df4253086b4db8b675a6e1b2436b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af578b4b43744644b720ab37606f9752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:23:49 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Creating image(s)
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "/opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "/opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "/opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk 1073741824" returned: 0 in 0.069s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Cannot resize image /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Ensure instance console log exists: /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Successfully created port: 837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Successfully updated port: 837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "refresh_cache-62134cad-732d-4a9d-b385-68a4317d3a72" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquired lock "refresh_cache-62134cad-732d-4a9d-b385-68a4317d3a72" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-251b31a5-1585-44f1-9a56-9b20c546a59c req-065dea83-ed9d-42f0-a3aa-2302416f1428 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-changed-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-251b31a5-1585-44f1-9a56-9b20c546a59c req-065dea83-ed9d-42f0-a3aa-2302416f1428 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Refreshing instance network info cache due to event network-changed-837a559f-90f1-4cf9-a8b2-318a064bba08. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-251b31a5-1585-44f1-9a56-9b20c546a59c req-065dea83-ed9d-42f0-a3aa-2302416f1428 service nova] Acquiring lock "refresh_cache-62134cad-732d-4a9d-b385-68a4317d3a72" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Updating instance_info_cache with network_info: [{"id": "837a559f-90f1-4cf9-a8b2-318a064bba08", "address": "fa:16:3e:94:f8:04", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837a559f-90", "ovs_interfaceid": "837a559f-90f1-4cf9-a8b2-318a064bba08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Releasing lock "refresh_cache-62134cad-732d-4a9d-b385-68a4317d3a72" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Instance network_info: |[{"id": "837a559f-90f1-4cf9-a8b2-318a064bba08", "address": "fa:16:3e:94:f8:04", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837a559f-90", "ovs_interfaceid": "837a559f-90f1-4cf9-a8b2-318a064bba08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-251b31a5-1585-44f1-9a56-9b20c546a59c req-065dea83-ed9d-42f0-a3aa-2302416f1428 service nova] Acquired lock "refresh_cache-62134cad-732d-4a9d-b385-68a4317d3a72" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.network.neutron [req-251b31a5-1585-44f1-9a56-9b20c546a59c req-065dea83-ed9d-42f0-a3aa-2302416f1428 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Refreshing network info cache for port 837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Start _get_guest_xml network_info=[{"id": "837a559f-90f1-4cf9-a8b2-318a064bba08", "address": "fa:16:3e:94:f8:04", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837a559f-90", "ovs_interfaceid": "837a559f-90f1-4cf9-a8b2-318a064bba08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:23:50 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:23:50 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:23:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-226371880',display_name='tempest-AttachVolumeNegativeTest-server-226371880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-226371880',id=46,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNeyKirb4irYk6lfp6az3rTYdJ7Skka0R7T404rm+cKDogaC7CuslKzVwP5lQgibgx99SQATy1Meh5lEVyMv129TpF/35EhDmIb9fGCZYFrG2Fv91+9p+Cd4a9AntlAXA==',key_name='tempest-keypair-116861489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-ruzxdy09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=62134cad-732d-4a9d-b385-68a4317d3a72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "837a559f-90f1-4cf9-a8b2-318a064bba08", "address": "fa:16:3e:94:f8:04", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837a559f-90", "ovs_interfaceid": "837a559f-90f1-4cf9-a8b2-318a064bba08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "837a559f-90f1-4cf9-a8b2-318a064bba08", "address": "fa:16:3e:94:f8:04", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837a559f-90", "ovs_interfaceid": "837a559f-90f1-4cf9-a8b2-318a064bba08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:f8:04,bridge_name='br-int',has_traffic_filtering=True,id=837a559f-90f1-4cf9-a8b2-318a064bba08,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837a559f-90') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'pci_devices' on Instance uuid 62134cad-732d-4a9d-b385-68a4317d3a72 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:23:51 user nova-compute[75342]:   <uuid>62134cad-732d-4a9d-b385-68a4317d3a72</uuid>
Nov 16 18:23:51 user nova-compute[75342]:   <name>instance-0000002e</name>
Nov 16 18:23:51 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:23:51 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:23:51 user nova-compute[75342]:   <metadata>
Nov 16 18:23:51 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:23:51 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:23:51 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeNegativeTest-server-226371880</nova:name>
Nov 16 18:23:51 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:23:50</nova:creationTime>
Nov 16 18:23:51 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:23:51 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:23:51 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:23:51 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:23:51 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:23:51 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:23:51 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:23:51 user nova-compute[75342]:       <nova:owner>
Nov 16 18:23:51 user nova-compute[75342]:         <nova:user uuid="c6df4253086b4db8b675a6e1b2436b87">tempest-AttachVolumeNegativeTest-825910471-project-member</nova:user>
Nov 16 18:23:51 user nova-compute[75342]:         <nova:project uuid="af578b4b43744644b720ab37606f9752">tempest-AttachVolumeNegativeTest-825910471</nova:project>
Nov 16 18:23:51 user nova-compute[75342]:       </nova:owner>
Nov 16 18:23:51 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:23:51 user nova-compute[75342]:       <nova:ports>
Nov 16 18:23:51 user nova-compute[75342]:         <nova:port uuid="837a559f-90f1-4cf9-a8b2-318a064bba08">
Nov 16 18:23:51 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 18:23:51 user nova-compute[75342]:         </nova:port>
Nov 16 18:23:51 user nova-compute[75342]:       </nova:ports>
Nov 16 18:23:51 user nova-compute[75342]:     </nova:instance>
Nov 16 18:23:51 user nova-compute[75342]:   </metadata>
Nov 16 18:23:51 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:23:51 user nova-compute[75342]:     <system>
Nov 16 18:23:51 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:23:51 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:23:51 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:23:51 user nova-compute[75342]:       <entry name="serial">62134cad-732d-4a9d-b385-68a4317d3a72</entry>
Nov 16 18:23:51 user nova-compute[75342]:       <entry name="uuid">62134cad-732d-4a9d-b385-68a4317d3a72</entry>
Nov 16 18:23:51 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:23:51 user nova-compute[75342]:     </system>
Nov 16 18:23:51 user nova-compute[75342]:   </sysinfo>
Nov 16 18:23:51 user nova-compute[75342]:   <os>
Nov 16 18:23:51 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:23:51 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:23:51 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:23:51 user nova-compute[75342]:   </os>
Nov 16 18:23:51 user nova-compute[75342]:   <features>
Nov 16 18:23:51 user nova-compute[75342]:     <acpi/>
Nov 16 18:23:51 user nova-compute[75342]:     <apic/>
Nov 16 18:23:51 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:23:51 user nova-compute[75342]:   </features>
Nov 16 18:23:51 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:23:51 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:23:51 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:23:51 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:23:51 user nova-compute[75342]:   </clock>
Nov 16 18:23:51 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:23:51 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:23:51 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:23:51 user nova-compute[75342]:   </cpu>
Nov 16 18:23:51 user nova-compute[75342]:   <devices>
Nov 16 18:23:51 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:23:51 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:23:51 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk"/>
Nov 16 18:23:51 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:23:51 user nova-compute[75342]:     </disk>
Nov 16 18:23:51 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:23:51 user nova-compute[75342]:       <mac address="fa:16:3e:94:f8:04"/>
Nov 16 18:23:51 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:23:51 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:23:51 user nova-compute[75342]:       <target dev="tap837a559f-90"/>
Nov 16 18:23:51 user nova-compute[75342]:     </interface>
Nov 16 18:23:51 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:23:51 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/console.log" append="off"/>
Nov 16 18:23:51 user nova-compute[75342]:     </serial>
Nov 16 18:23:51 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:23:51 user nova-compute[75342]:     <video>
Nov 16 18:23:51 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:23:51 user nova-compute[75342]:     </video>
Nov 16 18:23:51 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:23:51 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:23:51 user nova-compute[75342]:     </rng>
Nov 16 18:23:51 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:23:51 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:23:51 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:23:51 user nova-compute[75342]:     </memballoon>
Nov 16 18:23:51 user nova-compute[75342]:   </devices>
Nov 16 18:23:51 user nova-compute[75342]: </domain>
Nov 16 18:23:51 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-226371880',display_name='tempest-AttachVolumeNegativeTest-server-226371880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-226371880',id=46,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNeyKirb4irYk6lfp6az3rTYdJ7Skka0R7T404rm+cKDogaC7CuslKzVwP5lQgibgx99SQATy1Meh5lEVyMv129TpF/35EhDmIb9fGCZYFrG2Fv91+9p+Cd4a9AntlAXA==',key_name='tempest-keypair-116861489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-ruzxdy09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=62134cad-732d-4a9d-b385-68a4317d3a72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "837a559f-90f1-4cf9-a8b2-318a064bba08", "address": "fa:16:3e:94:f8:04", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837a559f-90", "ovs_interfaceid": "837a559f-90f1-4cf9-a8b2-318a064bba08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "837a559f-90f1-4cf9-a8b2-318a064bba08", "address": "fa:16:3e:94:f8:04", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837a559f-90", "ovs_interfaceid": "837a559f-90f1-4cf9-a8b2-318a064bba08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:f8:04,bridge_name='br-int',has_traffic_filtering=True,id=837a559f-90f1-4cf9-a8b2-318a064bba08,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837a559f-90') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG os_vif [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:f8:04,bridge_name='br-int',has_traffic_filtering=True,id=837a559f-90f1-4cf9-a8b2-318a064bba08,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837a559f-90') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcad8dda-63d9-5414-8919-d38e2f4eba4d', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap837a559f-90, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap837a559f-90, col_values=(('qos', UUID('0c492bb6-d402-4cc5-b278-be3307c9855b')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap837a559f-90, col_values=(('external_ids', {'iface-id': '837a559f-90f1-4cf9-a8b2-318a064bba08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:f8:04', 'vm-uuid': '62134cad-732d-4a9d-b385-68a4317d3a72'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:51 user nova-compute[75342]: INFO os_vif [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:f8:04,bridge_name='br-int',has_traffic_filtering=True,id=837a559f-90f1-4cf9-a8b2-318a064bba08,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837a559f-90')
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No VIF found with MAC fa:16:3e:94:f8:04, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-251b31a5-1585-44f1-9a56-9b20c546a59c req-065dea83-ed9d-42f0-a3aa-2302416f1428 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Updated VIF entry in instance network info cache for port 837a559f-90f1-4cf9-a8b2-318a064bba08. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-251b31a5-1585-44f1-9a56-9b20c546a59c req-065dea83-ed9d-42f0-a3aa-2302416f1428 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Updating instance_info_cache with network_info: [{"id": "837a559f-90f1-4cf9-a8b2-318a064bba08", "address": "fa:16:3e:94:f8:04", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837a559f-90", "ovs_interfaceid": "837a559f-90f1-4cf9-a8b2-318a064bba08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-251b31a5-1585-44f1-9a56-9b20c546a59c req-065dea83-ed9d-42f0-a3aa-2302416f1428 service nova] Releasing lock "refresh_cache-62134cad-732d-4a9d-b385-68a4317d3a72" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:51 user nova-compute[75342]: INFO nova.compute.manager [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attaching volume d4d0b0d8-e47f-488a-9151-c957856ae603 to /dev/vdb
Nov 16 18:23:51 user nova-compute[75342]: DEBUG os_brick.utils [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.067s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[716a4821-e6b6-41b5-ab4b-039cd60b906b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcffafa0-4172-43a9-92f9-d93cd6d140c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc537d-428d-4b07-be79-dc025af97cd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e7fc23-dd1f-4fa5-8962-3f1986e27849]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:23:51 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:23:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[097ee330-b09c-4b3a-ac59-f76379e99447]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG os_brick.utils [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:51 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updating existing volume attachment record: a4e44e99-7529-4a2d-a5d0-d8dae1ebb218 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:23:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:23:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-cdf7fd92-0b34-4c9b-bed9-397077bb62e2 req-fe3cd779-ef67-4f7b-8180-fc6c418b23fc service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cdf7fd92-0b34-4c9b-bed9-397077bb62e2 req-fe3cd779-ef67-4f7b-8180-fc6c418b23fc service nova] Acquiring lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cdf7fd92-0b34-4c9b-bed9-397077bb62e2 req-fe3cd779-ef67-4f7b-8180-fc6c418b23fc service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cdf7fd92-0b34-4c9b-bed9-397077bb62e2 req-fe3cd779-ef67-4f7b-8180-fc6c418b23fc service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-cdf7fd92-0b34-4c9b-bed9-397077bb62e2 req-fe3cd779-ef67-4f7b-8180-fc6c418b23fc service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] No waiting events found dispatching network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:52 user nova-compute[75342]: WARNING nova.compute.manager [req-cdf7fd92-0b34-4c9b-bed9-397077bb62e2 req-fe3cd779-ef67-4f7b-8180-fc6c418b23fc service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received unexpected event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 for instance with vm_state building and task_state spawning.
Nov 16 18:23:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:23:54 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Instance spawned successfully.
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:23:54 user nova-compute[75342]: INFO nova.compute.manager [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.compute.manager [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:23:54 user nova-compute[75342]: INFO nova.compute.manager [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Took 6.09 seconds to build instance.
Nov 16 18:23:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3d57ac57-70b9-4997-865a-1d14b0cd9f4f tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "62134cad-732d-4a9d-b385-68a4317d3a72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.253s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-cb53f13b-b957-44a6-b8f9-35f08de56b22 req-43450a51-11e1-4987-bc27-6bd84816a466 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cb53f13b-b957-44a6-b8f9-35f08de56b22 req-43450a51-11e1-4987-bc27-6bd84816a466 service nova] Acquiring lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cb53f13b-b957-44a6-b8f9-35f08de56b22 req-43450a51-11e1-4987-bc27-6bd84816a466 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cb53f13b-b957-44a6-b8f9-35f08de56b22 req-43450a51-11e1-4987-bc27-6bd84816a466 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-cb53f13b-b957-44a6-b8f9-35f08de56b22 req-43450a51-11e1-4987-bc27-6bd84816a466 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] No waiting events found dispatching network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:23:54 user nova-compute[75342]: WARNING nova.compute.manager [req-cb53f13b-b957-44a6-b8f9-35f08de56b22 req-43450a51-11e1-4987-bc27-6bd84816a466 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received unexpected event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 for instance with vm_state active and task_state None.
Nov 16 18:23:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:23:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:23:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:55 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:23:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbXKWpBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:23:56 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:56 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:23:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:23:56 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b664570e-1c64-4d62-95fb-272fa44b4835]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:23:56 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f94be6d-b500-47a1-bd88-c592e93dc1b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603] added
Nov 16 18:23:56 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[822faf86-f390-42bd-bc3c-ea59509336b6]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66087e5-6b01-4c94-b12b-cae8935316e8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbXKWpBG {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbXKWpBG" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abea5ed-7498-4544-a3f2-7bc7267429a0]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sbXKWpBG'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15c4c2f-60f1-4521-a358-d87f3aac6b3d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb22884-b1aa-434b-99c4-a6e3f9e056c2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:57 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:23:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:57 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:23:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5200a07a-4543-4416-a446-51c6826b8e84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603, portal: 172.16.0.220,3260]
Nov 16 18:23:57 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603, portal: 172.16.0.220,3260] successful.
Nov 16 18:23:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d986064-b143-4ce8-bf9f-25ab671ea2f2]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89fde4d-7781-4ab1-8786-481a6c42f34a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:57 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:23:57 user nova-compute[75342]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 (non-flash)
Nov 16 18:23:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:23:57 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:23:57 user nova-compute[75342]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 (non-flash)
Nov 16 18:23:57 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c1c163-09bf-4039-b027-0113e50065a8]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbXKWpBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:23:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23564316437633736', 'path': '/dev/sdd'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564316437633736', 'path': '/dev/sdd'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:23:58 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:23:58 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8413MB free_disk=25.05896759033203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.objects.instance [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:23:58 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:23:58 user nova-compute[75342]:   <source dev="/dev/sdd"/>
Nov 16 18:23:58 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:23:58 user nova-compute[75342]:   <serial>d4d0b0d8-e47f-488a-9151-c957856ae603</serial>
Nov 16 18:23:58 user nova-compute[75342]: </disk>
Nov 16 18:23:58 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 5edd2a74-89b9-4163-b452-d491be30059b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 62134cad-732d-4a9d-b385-68a4317d3a72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No VIF found with MAC fa:16:3e:a1:d6:05, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:23:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c742f827-c81b-4461-8282-a1cc9bdd38de tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.379s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:00 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:24:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:24:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:24:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:24:00 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:24:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:01 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updating instance_info_cache with network_info: [{"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:24:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:24:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:24:01 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:24:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:24:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:09 user nova-compute[75342]: INFO nova.compute.manager [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Detaching volume d4d0b0d8-e47f-488a-9151-c957856ae603
Nov 16 18:24:09 user nova-compute[75342]: INFO nova.virt.block_device [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attempting to driver detach volume d4d0b0d8-e47f-488a-9151-c957856ae603 from mountpoint /dev/vdb
Nov 16 18:24:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Attempting to detach device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:24:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:24:09 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:24:09 user nova-compute[75342]:   <source dev="/dev/sdd"/>
Nov 16 18:24:09 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:24:09 user nova-compute[75342]:   <serial>d4d0b0d8-e47f-488a-9151-c957856ae603</serial>
Nov 16 18:24:09 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:24:09 user nova-compute[75342]: </disk>
Nov 16 18:24:09 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:24:09 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Successfully detached device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the persistent domain config.
Nov 16 18:24:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:24:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:24:09 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:24:09 user nova-compute[75342]:   <source dev="/dev/sdd"/>
Nov 16 18:24:09 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:24:09 user nova-compute[75342]:   <serial>d4d0b0d8-e47f-488a-9151-c957856ae603</serial>
Nov 16 18:24:09 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:24:09 user nova-compute[75342]: </disk>
Nov 16 18:24:09 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:24:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:24:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:24:10 user nova-compute[75342]: INFO nova.compute.manager [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] instance snapshotting
Nov 16 18:24:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Beginning live snapshot process
Nov 16 18:24:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json -f qcow2 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json -f qcow2 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpor51p1fl/97ad6b8a6d974c899a71eb83224a56b5.delta 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpor51p1fl/97ad6b8a6d974c899a71eb83224a56b5.delta 1073741824" returned: 0 in 0.049s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:11 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 18:24:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:24:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 18:24:12 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 18:24:12 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:24:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpor51p1fl/97ad6b8a6d974c899a71eb83224a56b5.delta /opt/stack/data/nova/instances/snapshots/tmpor51p1fl/97ad6b8a6d974c899a71eb83224a56b5 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:12 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpor51p1fl/97ad6b8a6d974c899a71eb83224a56b5.delta /opt/stack/data/nova/instances/snapshots/tmpor51p1fl/97ad6b8a6d974c899a71eb83224a56b5" returned: 0 in 0.642s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:13 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Snapshot extracted, beginning image upload
Nov 16 18:24:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "01b66315-e6be-4f03-958c-514222a7848e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:24:14 user nova-compute[75342]: INFO nova.compute.claims [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Claim successful on node user
Nov 16 18:24:14 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:24:14 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:24:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG nova.policy [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48aea12e1e7c40f69b90ce451a9bf745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afab8ca8fb0e4810aff37187498d3855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:24:14 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Creating image(s)
Nov 16 18:24:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "/opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "/opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "/opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:14 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk 1073741824" returned: 0 in 0.051s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Successfully created port: 0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Cannot resize image /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Ensure instance console log exists: /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:15 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Snapshot image upload complete
Nov 16 18:24:15 user nova-compute[75342]: INFO nova.compute.manager [None req-f4c666c2-be73-492f-88a0-a44026484fb4 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Took 5.43 seconds to snapshot the instance on the hypervisor.
Nov 16 18:24:15 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Successfully updated port: 0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "refresh_cache-01b66315-e6be-4f03-958c-514222a7848e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquired lock "refresh_cache-01b66315-e6be-4f03-958c-514222a7848e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-01c79e2f-4379-46b0-a992-3c64ff13429a req-05b0aca6-123e-4045-b51e-48e40d87238d service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Received event network-changed-0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-01c79e2f-4379-46b0-a992-3c64ff13429a req-05b0aca6-123e-4045-b51e-48e40d87238d service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Refreshing instance network info cache due to event network-changed-0abf9549-d158-43b5-a957-c948cad17d00. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-01c79e2f-4379-46b0-a992-3c64ff13429a req-05b0aca6-123e-4045-b51e-48e40d87238d service nova] Acquiring lock "refresh_cache-01b66315-e6be-4f03-958c-514222a7848e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:24:15 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.network.neutron [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Updating instance_info_cache with network_info: [{"id": "0abf9549-d158-43b5-a957-c948cad17d00", "address": "fa:16:3e:0b:ec:23", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0abf9549-d1", "ovs_interfaceid": "0abf9549-d158-43b5-a957-c948cad17d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Releasing lock "refresh_cache-01b66315-e6be-4f03-958c-514222a7848e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Instance network_info: |[{"id": "0abf9549-d158-43b5-a957-c948cad17d00", "address": "fa:16:3e:0b:ec:23", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0abf9549-d1", "ovs_interfaceid": "0abf9549-d158-43b5-a957-c948cad17d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-01c79e2f-4379-46b0-a992-3c64ff13429a req-05b0aca6-123e-4045-b51e-48e40d87238d service nova] Acquired lock "refresh_cache-01b66315-e6be-4f03-958c-514222a7848e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.network.neutron [req-01c79e2f-4379-46b0-a992-3c64ff13429a req-05b0aca6-123e-4045-b51e-48e40d87238d service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Refreshing network info cache for port 0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Start _get_guest_xml network_info=[{"id": "0abf9549-d158-43b5-a957-c948cad17d00", "address": "fa:16:3e:0b:ec:23", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0abf9549-d1", "ovs_interfaceid": "0abf9549-d158-43b5-a957-c948cad17d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:24:16 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:24:16 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:24:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-97436471',display_name='tempest-VolumesSnapshotTestJSON-instance-97436471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-97436471',id=47,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaLE/YBTX0kw5WyXCIsJvKw7bBv5i9rM53irzP1/QE1EQR0Zea8cTVPl1LsEIT66qIOSwTbtjspLThlRQFeHEBzlLviBhsuIHYYfYUT7bEaSeKu6yFrhnMq4/8zG9mvkg==',key_name='tempest-keypair-1136286171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afab8ca8fb0e4810aff37187498d3855',ramdisk_id='',reservation_id='r-7vfei6mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-31047705',owner_user_name='tempest-VolumesSnapshotTestJSON-31047705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:24:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48aea12e1e7c40f69b90ce451a9bf745',uuid=01b66315-e6be-4f03-958c-514222a7848e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0abf9549-d158-43b5-a957-c948cad17d00", "address": "fa:16:3e:0b:ec:23", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0abf9549-d1", "ovs_interfaceid": "0abf9549-d158-43b5-a957-c948cad17d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converting VIF {"id": "0abf9549-d158-43b5-a957-c948cad17d00", "address": "fa:16:3e:0b:ec:23", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0abf9549-d1", "ovs_interfaceid": "0abf9549-d158-43b5-a957-c948cad17d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=0abf9549-d158-43b5-a957-c948cad17d00,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0abf9549-d1') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lazy-loading 'pci_devices' on Instance uuid 01b66315-e6be-4f03-958c-514222a7848e {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:24:16 user nova-compute[75342]:   <uuid>01b66315-e6be-4f03-958c-514222a7848e</uuid>
Nov 16 18:24:16 user nova-compute[75342]:   <name>instance-0000002f</name>
Nov 16 18:24:16 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:24:16 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:24:16 user nova-compute[75342]:   <metadata>
Nov 16 18:24:16 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:24:16 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:24:16 user nova-compute[75342]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-97436471</nova:name>
Nov 16 18:24:16 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:24:16</nova:creationTime>
Nov 16 18:24:16 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:24:16 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:24:16 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:24:16 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:24:16 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:24:16 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:24:16 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:24:16 user nova-compute[75342]:       <nova:owner>
Nov 16 18:24:16 user nova-compute[75342]:         <nova:user uuid="48aea12e1e7c40f69b90ce451a9bf745">tempest-VolumesSnapshotTestJSON-31047705-project-member</nova:user>
Nov 16 18:24:16 user nova-compute[75342]:         <nova:project uuid="afab8ca8fb0e4810aff37187498d3855">tempest-VolumesSnapshotTestJSON-31047705</nova:project>
Nov 16 18:24:16 user nova-compute[75342]:       </nova:owner>
Nov 16 18:24:16 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:24:16 user nova-compute[75342]:       <nova:ports>
Nov 16 18:24:16 user nova-compute[75342]:         <nova:port uuid="0abf9549-d158-43b5-a957-c948cad17d00">
Nov 16 18:24:16 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 18:24:16 user nova-compute[75342]:         </nova:port>
Nov 16 18:24:16 user nova-compute[75342]:       </nova:ports>
Nov 16 18:24:16 user nova-compute[75342]:     </nova:instance>
Nov 16 18:24:16 user nova-compute[75342]:   </metadata>
Nov 16 18:24:16 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:24:16 user nova-compute[75342]:     <system>
Nov 16 18:24:16 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:24:16 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:24:16 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:24:16 user nova-compute[75342]:       <entry name="serial">01b66315-e6be-4f03-958c-514222a7848e</entry>
Nov 16 18:24:16 user nova-compute[75342]:       <entry name="uuid">01b66315-e6be-4f03-958c-514222a7848e</entry>
Nov 16 18:24:16 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:24:16 user nova-compute[75342]:     </system>
Nov 16 18:24:16 user nova-compute[75342]:   </sysinfo>
Nov 16 18:24:16 user nova-compute[75342]:   <os>
Nov 16 18:24:16 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:24:16 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:24:16 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:24:16 user nova-compute[75342]:   </os>
Nov 16 18:24:16 user nova-compute[75342]:   <features>
Nov 16 18:24:16 user nova-compute[75342]:     <acpi/>
Nov 16 18:24:16 user nova-compute[75342]:     <apic/>
Nov 16 18:24:16 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:24:16 user nova-compute[75342]:   </features>
Nov 16 18:24:16 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:24:16 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:24:16 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:24:16 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:24:16 user nova-compute[75342]:   </clock>
Nov 16 18:24:16 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:24:16 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:24:16 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:24:16 user nova-compute[75342]:   </cpu>
Nov 16 18:24:16 user nova-compute[75342]:   <devices>
Nov 16 18:24:16 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:24:16 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:24:16 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk"/>
Nov 16 18:24:16 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:24:16 user nova-compute[75342]:     </disk>
Nov 16 18:24:16 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:24:16 user nova-compute[75342]:       <mac address="fa:16:3e:0b:ec:23"/>
Nov 16 18:24:16 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:24:16 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:24:16 user nova-compute[75342]:       <target dev="tap0abf9549-d1"/>
Nov 16 18:24:16 user nova-compute[75342]:     </interface>
Nov 16 18:24:16 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:24:16 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/console.log" append="off"/>
Nov 16 18:24:16 user nova-compute[75342]:     </serial>
Nov 16 18:24:16 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:24:16 user nova-compute[75342]:     <video>
Nov 16 18:24:16 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:24:16 user nova-compute[75342]:     </video>
Nov 16 18:24:16 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:24:16 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:24:16 user nova-compute[75342]:     </rng>
Nov 16 18:24:16 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:24:16 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:24:16 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:24:16 user nova-compute[75342]:     </memballoon>
Nov 16 18:24:16 user nova-compute[75342]:   </devices>
Nov 16 18:24:16 user nova-compute[75342]: </domain>
Nov 16 18:24:16 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:24:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-97436471',display_name='tempest-VolumesSnapshotTestJSON-instance-97436471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-97436471',id=47,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaLE/YBTX0kw5WyXCIsJvKw7bBv5i9rM53irzP1/QE1EQR0Zea8cTVPl1LsEIT66qIOSwTbtjspLThlRQFeHEBzlLviBhsuIHYYfYUT7bEaSeKu6yFrhnMq4/8zG9mvkg==',key_name='tempest-keypair-1136286171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afab8ca8fb0e4810aff37187498d3855',ramdisk_id='',reservation_id='r-7vfei6mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-31047705',owner_user_name='tempest-VolumesSnapshotTestJSON-31047705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:24:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48aea12e1e7c40f69b90ce451a9bf745',uuid=01b66315-e6be-4f03-958c-514222a7848e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0abf9549-d158-43b5-a957-c948cad17d00", "address": "fa:16:3e:0b:ec:23", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0abf9549-d1", "ovs_interfaceid": "0abf9549-d158-43b5-a957-c948cad17d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converting VIF {"id": "0abf9549-d158-43b5-a957-c948cad17d00", "address": "fa:16:3e:0b:ec:23", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0abf9549-d1", "ovs_interfaceid": "0abf9549-d158-43b5-a957-c948cad17d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=0abf9549-d158-43b5-a957-c948cad17d00,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0abf9549-d1') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG os_vif [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=0abf9549-d158-43b5-a957-c948cad17d00,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0abf9549-d1') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5969bfc8-6441-5fa5-9784-56fde679abd4', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0abf9549-d1, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0abf9549-d1, col_values=(('qos', UUID('c9f96983-183c-4399-8654-eeedb8efec5d')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0abf9549-d1, col_values=(('external_ids', {'iface-id': '0abf9549-d158-43b5-a957-c948cad17d00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:ec:23', 'vm-uuid': '01b66315-e6be-4f03-958c-514222a7848e'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:16 user nova-compute[75342]: INFO os_vif [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=0abf9549-d158-43b5-a957-c948cad17d00,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0abf9549-d1')
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] No VIF found with MAC fa:16:3e:0b:ec:23, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.network.neutron [req-01c79e2f-4379-46b0-a992-3c64ff13429a req-05b0aca6-123e-4045-b51e-48e40d87238d service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Updated VIF entry in instance network info cache for port 0abf9549-d158-43b5-a957-c948cad17d00. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG nova.network.neutron [req-01c79e2f-4379-46b0-a992-3c64ff13429a req-05b0aca6-123e-4045-b51e-48e40d87238d service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Updating instance_info_cache with network_info: [{"id": "0abf9549-d158-43b5-a957-c948cad17d00", "address": "fa:16:3e:0b:ec:23", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0abf9549-d1", "ovs_interfaceid": "0abf9549-d158-43b5-a957-c948cad17d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:24:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-01c79e2f-4379-46b0-a992-3c64ff13429a req-05b0aca6-123e-4045-b51e-48e40d87238d service nova] Releasing lock "refresh_cache-01b66315-e6be-4f03-958c-514222a7848e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "7399ebfd-2764-47f1-90fe-d20079dfd171" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-d60c138b-f21c-48e9-b9c7-42ea95a829e5 req-839fd55e-5be6-4752-8310-19d2152a3066 service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Received event network-vif-plugged-0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d60c138b-f21c-48e9-b9c7-42ea95a829e5 req-839fd55e-5be6-4752-8310-19d2152a3066 service nova] Acquiring lock "01b66315-e6be-4f03-958c-514222a7848e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d60c138b-f21c-48e9-b9c7-42ea95a829e5 req-839fd55e-5be6-4752-8310-19d2152a3066 service nova] Lock "01b66315-e6be-4f03-958c-514222a7848e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d60c138b-f21c-48e9-b9c7-42ea95a829e5 req-839fd55e-5be6-4752-8310-19d2152a3066 service nova] Lock "01b66315-e6be-4f03-958c-514222a7848e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-d60c138b-f21c-48e9-b9c7-42ea95a829e5 req-839fd55e-5be6-4752-8310-19d2152a3066 service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] No waiting events found dispatching network-vif-plugged-0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:24:17 user nova-compute[75342]: WARNING nova.compute.manager [req-d60c138b-f21c-48e9-b9c7-42ea95a829e5 req-839fd55e-5be6-4752-8310-19d2152a3066 service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Received unexpected event network-vif-plugged-0abf9549-d158-43b5-a957-c948cad17d00 for instance with vm_state building and task_state spawning.
Nov 16 18:24:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:24:17 user nova-compute[75342]: INFO nova.compute.claims [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Claim successful on node user
Nov 16 18:24:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG nova.network.neutron [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:24:18 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:24:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG nova.policy [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8824c1e02e5e41a7beb3a08a5e5b7124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30aa87387053460b9575cd8fb070af29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:24:18 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Creating image(s)
Nov 16 18:24:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "/opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "/opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "/opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.076s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "a0b4604d89ecc241091c24869f62316f1e7e3572" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "a0b4604d89ecc241091c24869f62316f1e7e3572" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572.part --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.network.neutron [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Successfully created port: 2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.virt.images [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] 134ad093-3e22-485d-b11d-a959484ff0ae was qcow2, converting to raw {{(pid=75342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572.part /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572.converted {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:24:19 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Instance spawned successfully.
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572.part /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572.converted" returned: 0 in 0.287s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572.converted --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-2670c337-f466-4bba-925b-abe585ae0d48 req-be938581-eae6-4bf3-92bf-554b4dd10560 service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Received event network-vif-plugged-0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2670c337-f466-4bba-925b-abe585ae0d48 req-be938581-eae6-4bf3-92bf-554b4dd10560 service nova] Acquiring lock "01b66315-e6be-4f03-958c-514222a7848e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2670c337-f466-4bba-925b-abe585ae0d48 req-be938581-eae6-4bf3-92bf-554b4dd10560 service nova] Lock "01b66315-e6be-4f03-958c-514222a7848e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2670c337-f466-4bba-925b-abe585ae0d48 req-be938581-eae6-4bf3-92bf-554b4dd10560 service nova] Lock "01b66315-e6be-4f03-958c-514222a7848e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-2670c337-f466-4bba-925b-abe585ae0d48 req-be938581-eae6-4bf3-92bf-554b4dd10560 service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] No waiting events found dispatching network-vif-plugged-0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:24:20 user nova-compute[75342]: WARNING nova.compute.manager [req-2670c337-f466-4bba-925b-abe585ae0d48 req-be938581-eae6-4bf3-92bf-554b4dd10560 service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Received unexpected event network-vif-plugged-0abf9549-d158-43b5-a957-c948cad17d00 for instance with vm_state building and task_state spawning.
Nov 16 18:24:20 user nova-compute[75342]: INFO nova.compute.manager [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 16 18:24:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572.converted --force-share --output=json" returned: 0 in 0.299s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "a0b4604d89ecc241091c24869f62316f1e7e3572" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.722s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:20 user nova-compute[75342]: INFO nova.compute.manager [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Took 6.40 seconds to build instance.
Nov 16 18:24:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Successfully updated port: 2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b55c6f28-2218-44d9-a54d-641193d7379d tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.507s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572 --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "a0b4604d89ecc241091c24869f62316f1e7e3572" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "a0b4604d89ecc241091c24869f62316f1e7e3572" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquired lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572 --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572,backing_fmt=raw /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572,backing_fmt=raw /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk 1073741824" returned: 0 in 0.050s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "a0b4604d89ecc241091c24869f62316f1e7e3572" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572 --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Ensure instance console log exists: /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.network.neutron [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Updating instance_info_cache with network_info: [{"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Releasing lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Instance network_info: |[{"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Start _get_guest_xml network_info=[{"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='aff2e93e51430bc18449d9930cba4583',container_format='bare',created_at=2023-11-16T18:24:10Z,direct_url=<?>,disk_format='qcow2',id=134ad093-3e22-485d-b11d-a959484ff0ae,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-203057742',owner='30aa87387053460b9575cd8fb070af29',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T18:24:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': '134ad093-3e22-485d-b11d-a959484ff0ae'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:24:21 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:24:21 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='aff2e93e51430bc18449d9930cba4583',container_format='bare',created_at=2023-11-16T18:24:10Z,direct_url=<?>,disk_format='qcow2',id=134ad093-3e22-485d-b11d-a959484ff0ae,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-203057742',owner='30aa87387053460b9575cd8fb070af29',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T18:24:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-55282173',display_name='tempest-TestStampPattern-server-55282173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-55282173',id=48,image_ref='134ad093-3e22-485d-b11d-a959484ff0ae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWRDrITjp8lV/bdrgBAnPtDPz8fSKsjO1nF68velNrRvChHnjZw1cZB/Ss4eCH0mBq/oxSBLNXAorbiApAZVZPOeZgKRGyEshGk6TU4B3fctyTamQK6QGS51fl7NMXCbw==',key_name='tempest-TestStampPattern-842187603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30aa87387053460b9575cd8fb070af29',ramdisk_id='',reservation_id='r-nqaxoc07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9fb5b39f-affa-4dc0-b38a-3e3bfad36495',image_min_disk='1',image_min_ram='0',image_owner_id='30aa87387053460b9575cd8fb070af29',image_owner_project_name='tempest-TestStampPattern-1612033621',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1612033621-project-member',image_user_id='8824c1e02e5e41a7beb3a08a5e5b7124',network_allocated='True',owner_project_name='tempest-TestStampPattern-1612033621',owner_user_name='tempest-TestStampPattern-1612033621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:24:18Z,user_data=None,user_id='8824c1e02e5e41a7beb3a08a5e5b7124',uuid=7399ebfd-2764-47f1-90fe-d20079dfd171,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converting VIF {"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=2449ec97-62ae-4f59-a0be-5af2ec7bc250,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2449ec97-62') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.objects.instance [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lazy-loading 'pci_devices' on Instance uuid 7399ebfd-2764-47f1-90fe-d20079dfd171 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:24:21 user nova-compute[75342]:   <uuid>7399ebfd-2764-47f1-90fe-d20079dfd171</uuid>
Nov 16 18:24:21 user nova-compute[75342]:   <name>instance-00000030</name>
Nov 16 18:24:21 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:24:21 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:24:21 user nova-compute[75342]:   <metadata>
Nov 16 18:24:21 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:24:21 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:24:21 user nova-compute[75342]:       <nova:name>tempest-TestStampPattern-server-55282173</nova:name>
Nov 16 18:24:21 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:24:21</nova:creationTime>
Nov 16 18:24:21 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:24:21 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:24:21 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:24:21 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:24:21 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:24:21 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:24:21 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:24:21 user nova-compute[75342]:       <nova:owner>
Nov 16 18:24:21 user nova-compute[75342]:         <nova:user uuid="8824c1e02e5e41a7beb3a08a5e5b7124">tempest-TestStampPattern-1612033621-project-member</nova:user>
Nov 16 18:24:21 user nova-compute[75342]:         <nova:project uuid="30aa87387053460b9575cd8fb070af29">tempest-TestStampPattern-1612033621</nova:project>
Nov 16 18:24:21 user nova-compute[75342]:       </nova:owner>
Nov 16 18:24:21 user nova-compute[75342]:       <nova:root type="image" uuid="134ad093-3e22-485d-b11d-a959484ff0ae"/>
Nov 16 18:24:21 user nova-compute[75342]:       <nova:ports>
Nov 16 18:24:21 user nova-compute[75342]:         <nova:port uuid="2449ec97-62ae-4f59-a0be-5af2ec7bc250">
Nov 16 18:24:21 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 18:24:21 user nova-compute[75342]:         </nova:port>
Nov 16 18:24:21 user nova-compute[75342]:       </nova:ports>
Nov 16 18:24:21 user nova-compute[75342]:     </nova:instance>
Nov 16 18:24:21 user nova-compute[75342]:   </metadata>
Nov 16 18:24:21 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:24:21 user nova-compute[75342]:     <system>
Nov 16 18:24:21 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:24:21 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:24:21 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:24:21 user nova-compute[75342]:       <entry name="serial">7399ebfd-2764-47f1-90fe-d20079dfd171</entry>
Nov 16 18:24:21 user nova-compute[75342]:       <entry name="uuid">7399ebfd-2764-47f1-90fe-d20079dfd171</entry>
Nov 16 18:24:21 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:24:21 user nova-compute[75342]:     </system>
Nov 16 18:24:21 user nova-compute[75342]:   </sysinfo>
Nov 16 18:24:21 user nova-compute[75342]:   <os>
Nov 16 18:24:21 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:24:21 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:24:21 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:24:21 user nova-compute[75342]:   </os>
Nov 16 18:24:21 user nova-compute[75342]:   <features>
Nov 16 18:24:21 user nova-compute[75342]:     <acpi/>
Nov 16 18:24:21 user nova-compute[75342]:     <apic/>
Nov 16 18:24:21 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:24:21 user nova-compute[75342]:   </features>
Nov 16 18:24:21 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:24:21 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:24:21 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:24:21 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:24:21 user nova-compute[75342]:   </clock>
Nov 16 18:24:21 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:24:21 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:24:21 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:24:21 user nova-compute[75342]:   </cpu>
Nov 16 18:24:21 user nova-compute[75342]:   <devices>
Nov 16 18:24:21 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:24:21 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:24:21 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk"/>
Nov 16 18:24:21 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:24:21 user nova-compute[75342]:     </disk>
Nov 16 18:24:21 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:24:21 user nova-compute[75342]:       <mac address="fa:16:3e:97:03:8c"/>
Nov 16 18:24:21 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:24:21 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:24:21 user nova-compute[75342]:       <target dev="tap2449ec97-62"/>
Nov 16 18:24:21 user nova-compute[75342]:     </interface>
Nov 16 18:24:21 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:24:21 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/console.log" append="off"/>
Nov 16 18:24:21 user nova-compute[75342]:     </serial>
Nov 16 18:24:21 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:24:21 user nova-compute[75342]:     <video>
Nov 16 18:24:21 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:24:21 user nova-compute[75342]:     </video>
Nov 16 18:24:21 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:24:21 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:24:21 user nova-compute[75342]:     </rng>
Nov 16 18:24:21 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:24:21 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:24:21 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:24:21 user nova-compute[75342]:     </memballoon>
Nov 16 18:24:21 user nova-compute[75342]:   </devices>
Nov 16 18:24:21 user nova-compute[75342]: </domain>
Nov 16 18:24:21 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-55282173',display_name='tempest-TestStampPattern-server-55282173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-55282173',id=48,image_ref='134ad093-3e22-485d-b11d-a959484ff0ae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWRDrITjp8lV/bdrgBAnPtDPz8fSKsjO1nF68velNrRvChHnjZw1cZB/Ss4eCH0mBq/oxSBLNXAorbiApAZVZPOeZgKRGyEshGk6TU4B3fctyTamQK6QGS51fl7NMXCbw==',key_name='tempest-TestStampPattern-842187603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30aa87387053460b9575cd8fb070af29',ramdisk_id='',reservation_id='r-nqaxoc07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9fb5b39f-affa-4dc0-b38a-3e3bfad36495',image_min_disk='1',image_min_ram='0',image_owner_id='30aa87387053460b9575cd8fb070af29',image_owner_project_name='tempest-TestStampPattern-1612033621',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1612033621-project-member',image_user_id='8824c1e02e5e41a7beb3a08a5e5b7124',network_allocated='True',owner_project_name='tempest-TestStampPattern-1612033621',owner_user_name='tempest-TestStampPattern-1612033621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:24:18Z,user_data=None,user_id='8824c1e02e5e41a7beb3a08a5e5b7124',uuid=7399ebfd-2764-47f1-90fe-d20079dfd171,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converting VIF {"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=2449ec97-62ae-4f59-a0be-5af2ec7bc250,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2449ec97-62') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG os_vif [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=2449ec97-62ae-4f59-a0be-5af2ec7bc250,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2449ec97-62') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cbbb789-4043-5dad-8d9c-1251b739fa8a', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2449ec97-62, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2449ec97-62, col_values=(('qos', UUID('9b5b11b1-b072-4665-a272-41e89b5e0290')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2449ec97-62, col_values=(('external_ids', {'iface-id': '2449ec97-62ae-4f59-a0be-5af2ec7bc250', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:03:8c', 'vm-uuid': '7399ebfd-2764-47f1-90fe-d20079dfd171'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:21 user nova-compute[75342]: INFO os_vif [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=2449ec97-62ae-4f59-a0be-5af2ec7bc250,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2449ec97-62')
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:24:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] No VIF found with MAC fa:16:3e:97:03:8c, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-756aeb21-1999-4046-a24f-f33070bf65f5 req-be8b268b-4f5f-41ed-ba5a-ffb72349e5a9 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received event network-changed-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-756aeb21-1999-4046-a24f-f33070bf65f5 req-be8b268b-4f5f-41ed-ba5a-ffb72349e5a9 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Refreshing instance network info cache due to event network-changed-2449ec97-62ae-4f59-a0be-5af2ec7bc250. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-756aeb21-1999-4046-a24f-f33070bf65f5 req-be8b268b-4f5f-41ed-ba5a-ffb72349e5a9 service nova] Acquiring lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-756aeb21-1999-4046-a24f-f33070bf65f5 req-be8b268b-4f5f-41ed-ba5a-ffb72349e5a9 service nova] Acquired lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG nova.network.neutron [req-756aeb21-1999-4046-a24f-f33070bf65f5 req-be8b268b-4f5f-41ed-ba5a-ffb72349e5a9 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Refreshing network info cache for port 2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG nova.network.neutron [req-756aeb21-1999-4046-a24f-f33070bf65f5 req-be8b268b-4f5f-41ed-ba5a-ffb72349e5a9 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Updated VIF entry in instance network info cache for port 2449ec97-62ae-4f59-a0be-5af2ec7bc250. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG nova.network.neutron [req-756aeb21-1999-4046-a24f-f33070bf65f5 req-be8b268b-4f5f-41ed-ba5a-ffb72349e5a9 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Updating instance_info_cache with network_info: [{"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-756aeb21-1999-4046-a24f-f33070bf65f5 req-be8b268b-4f5f-41ed-ba5a-ffb72349e5a9 service nova] Releasing lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-e84aca1e-3df3-436f-85fd-9d77fbebc211 req-beaa24b3-7c22-4201-9884-fba9a7ff022d service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received event network-vif-plugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e84aca1e-3df3-436f-85fd-9d77fbebc211 req-beaa24b3-7c22-4201-9884-fba9a7ff022d service nova] Acquiring lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e84aca1e-3df3-436f-85fd-9d77fbebc211 req-beaa24b3-7c22-4201-9884-fba9a7ff022d service nova] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e84aca1e-3df3-436f-85fd-9d77fbebc211 req-beaa24b3-7c22-4201-9884-fba9a7ff022d service nova] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-e84aca1e-3df3-436f-85fd-9d77fbebc211 req-beaa24b3-7c22-4201-9884-fba9a7ff022d service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] No waiting events found dispatching network-vif-plugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:24:22 user nova-compute[75342]: WARNING nova.compute.manager [req-e84aca1e-3df3-436f-85fd-9d77fbebc211 req-beaa24b3-7c22-4201-9884-fba9a7ff022d service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received unexpected event network-vif-plugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 for instance with vm_state building and task_state spawning.
Nov 16 18:24:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:24:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:24:24 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Instance spawned successfully.
Nov 16 18:24:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:24:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:24:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:24:24 user nova-compute[75342]: INFO nova.compute.manager [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 16 18:24:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:24:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-f061e348-e1d3-4190-9b50-cb7533ccda11 req-6e4c807e-bc11-4714-9b46-809a35ac2c0c service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received event network-vif-plugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:24:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f061e348-e1d3-4190-9b50-cb7533ccda11 req-6e4c807e-bc11-4714-9b46-809a35ac2c0c service nova] Acquiring lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f061e348-e1d3-4190-9b50-cb7533ccda11 req-6e4c807e-bc11-4714-9b46-809a35ac2c0c service nova] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f061e348-e1d3-4190-9b50-cb7533ccda11 req-6e4c807e-bc11-4714-9b46-809a35ac2c0c service nova] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-f061e348-e1d3-4190-9b50-cb7533ccda11 req-6e4c807e-bc11-4714-9b46-809a35ac2c0c service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] No waiting events found dispatching network-vif-plugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:24:24 user nova-compute[75342]: WARNING nova.compute.manager [req-f061e348-e1d3-4190-9b50-cb7533ccda11 req-6e4c807e-bc11-4714-9b46-809a35ac2c0c service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received unexpected event network-vif-plugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 for instance with vm_state building and task_state spawning.
Nov 16 18:24:24 user nova-compute[75342]: INFO nova.compute.manager [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Took 6.99 seconds to build instance.
Nov 16 18:24:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7733028c-2a9d-4113-85ad-b633f0e6465b tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.097s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:30 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 is timed out.
Nov 16 18:24:30 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Successfully detached device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the live domain config.
Nov 16 18:24:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbXKWpBG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:24:30 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e5387e-bca1-4843-a8a2-8a7019acf9e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:24:30 user nova-compute[75342]: No targets found.
Nov 16 18:24:30 user nova-compute[75342]: iSNS:
Nov 16 18:24:30 user nova-compute[75342]: No targets found.
Nov 16 18:24:30 user nova-compute[75342]: STATIC:
Nov 16 18:24:30 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603
Nov 16 18:24:30 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:24:30 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:24:30 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb
Nov 16 18:24:30 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:24:30 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:24:30 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d
Nov 16 18:24:30 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:24:30 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:24:30 user nova-compute[75342]: FIRMWARE:
Nov 16 18:24:30 user nova-compute[75342]: No targets found.
Nov 16 18:24:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:24:30 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:24:30 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf1f11-28d5-4889-9193-ba4d2023b2d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9f6760-c898-4e6e-817e-43f01d7dea73]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:24:30 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:24:30 user nova-compute[75342]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 (non-flash)
Nov 16 18:24:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:24:30 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:24:30 user nova-compute[75342]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 (non-flash)
Nov 16 18:24:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a451b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603'): ({'sdd'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Removing single pathed devices sdd {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4e806a-40a3-4736-bf8c-08c70a547ade]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74520e48-d1f8-4480-80a8-93e8e4f42ae9]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Flushing IO for device /dev/sdd {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7398fa1-1429-47d7-8e11-eb7ebdf5ff57]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede3bb1d-b820-4386-8ab6-0b0a259b94b5]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f13e5e9-9505-40e8-8d14-04dbed46f624]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca0aba5-741d-4c4e-9afe-eeef3e626745]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603, portal: 172.16.0.220,3260]
Nov 16 18:24:30 user nova-compute[75342]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603, portal: 172.16.0.220,3260] successful.
Nov 16 18:24:30 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d0b0d8-e47f-488a-9151-c957856ae603 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2471c01-7a1f-4d50-b42e-0ea73090d865]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== disconnect_volume: return (314ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:24:30 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:24:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:24:31 user nova-compute[75342]: DEBUG nova.objects.instance [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:24:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-5f9d975f-d6ca-4619-a60b-445d28ab6132 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.741s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:24:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:24:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:24:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:24:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:24:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:51 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:24:51 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:24:51 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:24:51 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:24:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:54 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:24:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.rescue --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:24:59 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:24:59 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:24:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8070MB free_disk=24.846050262451172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 5edd2a74-89b9-4163-b452-d491be30059b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 62134cad-732d-4a9d-b385-68a4317d3a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 01b66315-e6be-4f03-958c-514222a7848e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 7399ebfd-2764-47f1-90fe-d20079dfd171 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:24:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:25:00 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:25:00 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:25:00 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:25:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:25:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:01 user nova-compute[75342]: DEBUG nova.objects.instance [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:25:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:01 user nova-compute[75342]: INFO nova.compute.manager [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attaching volume c11c8476-84df-4ede-b792-8df0e7f20b97 to /dev/vdb
Nov 16 18:25:02 user nova-compute[75342]: DEBUG os_brick.utils [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf4190f-c1c7-4e0f-8f38-638b398bde73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1e3ae8-5f57-4694-8c42-244c6792df7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e984c3-d95f-4b5b-a58e-d633d1088689]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1fe5a3-d6b1-4f97-ae6b-d2e31927bd30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:25:02 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:25:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[12defcee-7e5d-4599-9cb6-ee697b98cf3f]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG os_brick.utils [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:25:02 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updating existing volume attachment record: 9bf09cdb-71b4-4e1b-8935-214595c20196 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:25:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:25:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:25:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:25:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:25:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:25:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Updating instance_info_cache with network_info: [{"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:25:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:25:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:25:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:25:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsiFveEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:25:07 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:25:07 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:25:07 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9c4c36-e924-49aa-a433-9b0cc1f99dbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:25:07 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ad533c-703f-4cbc-8132-783098524f4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97] added
Nov 16 18:25:07 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc974afd-fab5-4a07-b320-447a96c9c391]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ec1326-fabc-428d-b15f-b9fd6af3ad3a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsiFveEg {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsiFveEg" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[39098737-baa2-415b-a680-2790fa3959f3]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jsiFveEg'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[90802fd1-233c-4d7a-aaf2-43c0f33a461e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed991a1-c238-4573-9be5-14e7de64aa91]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:25:07 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:25:07 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:25:07 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:25:07 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b864d-0e3d-475d-8fa2-37c0064039f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97, portal: 172.16.0.220,3260]
Nov 16 18:25:07 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97, portal: 172.16.0.220,3260] successful.
Nov 16 18:25:07 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad58419c-5c66-402d-b886-0eaffca61946]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d2b6fe-7735-4854-89d6-6a68a476dd63]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:25:07 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:25:07 user nova-compute[75342]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 (non-flash)
Nov 16 18:25:07 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:25:07 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:25:07 user nova-compute[75342]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 (non-flash)
Nov 16 18:25:07 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d06078f-927d-4c66-920e-6c8531375185]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:25:07 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsiFveEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:25:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:25:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23766383438376230', 'path': '/dev/sdd'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:25:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766383438376230', 'path': '/dev/sdd'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:25:08 user nova-compute[75342]: DEBUG nova.objects.instance [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:25:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:25:08 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:25:08 user nova-compute[75342]:   <source dev="/dev/sdd"/>
Nov 16 18:25:08 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:25:08 user nova-compute[75342]:   <serial>c11c8476-84df-4ede-b792-8df0e7f20b97</serial>
Nov 16 18:25:08 user nova-compute[75342]: </disk>
Nov 16 18:25:08 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:25:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:25:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:25:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No VIF found with MAC fa:16:3e:a1:d6:05, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:25:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-dc037753-83ce-4357-9019-86e68789c885 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.100s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:10 user nova-compute[75342]: INFO nova.compute.manager [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Detaching volume c11c8476-84df-4ede-b792-8df0e7f20b97
Nov 16 18:25:10 user nova-compute[75342]: INFO nova.virt.block_device [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attempting to driver detach volume c11c8476-84df-4ede-b792-8df0e7f20b97 from mountpoint /dev/vdb
Nov 16 18:25:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Attempting to detach device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:25:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:25:10 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:25:10 user nova-compute[75342]:   <source dev="/dev/sdd"/>
Nov 16 18:25:10 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:25:10 user nova-compute[75342]:   <serial>c11c8476-84df-4ede-b792-8df0e7f20b97</serial>
Nov 16 18:25:10 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:25:10 user nova-compute[75342]: </disk>
Nov 16 18:25:10 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:25:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Successfully detached device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the persistent domain config.
Nov 16 18:25:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:25:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:25:10 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:25:10 user nova-compute[75342]:   <source dev="/dev/sdd"/>
Nov 16 18:25:10 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:25:10 user nova-compute[75342]:   <serial>c11c8476-84df-4ede-b792-8df0e7f20b97</serial>
Nov 16 18:25:10 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:25:10 user nova-compute[75342]: </disk>
Nov 16 18:25:10 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:25:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:25:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:25:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:25:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:25:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:25:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:25:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:25:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:25:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:25:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:26 user nova-compute[75342]: INFO nova.compute.manager [None req-d26c1f85-2acf-4f78-b619-672a9e3a0eb8 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Unrescuing
Nov 16 18:25:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d26c1f85-2acf-4f78-b619-672a9e3a0eb8 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d26c1f85-2acf-4f78-b619-672a9e3a0eb8 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquired lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG nova.network.neutron [None req-d26c1f85-2acf-4f78-b619-672a9e3a0eb8 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG nova.network.neutron [None req-d26c1f85-2acf-4f78-b619-672a9e3a0eb8 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updating instance_info_cache with network_info: [{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d26c1f85-2acf-4f78-b619-672a9e3a0eb8 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Releasing lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG nova.objects.instance [None req-d26c1f85-2acf-4f78-b619-672a9e3a0eb8 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'flavor' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:26 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:27 user nova-compute[75342]: DEBUG nova.compute.manager [req-ea5aba6c-fcdc-4b16-a68b-927b27a4a774 req-0fa3866c-5f3e-48f7-9ddf-fb82193c03a2 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-unplugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ea5aba6c-fcdc-4b16-a68b-927b27a4a774 req-0fa3866c-5f3e-48f7-9ddf-fb82193c03a2 service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ea5aba6c-fcdc-4b16-a68b-927b27a4a774 req-0fa3866c-5f3e-48f7-9ddf-fb82193c03a2 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ea5aba6c-fcdc-4b16-a68b-927b27a4a774 req-0fa3866c-5f3e-48f7-9ddf-fb82193c03a2 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:27 user nova-compute[75342]: DEBUG nova.compute.manager [req-ea5aba6c-fcdc-4b16-a68b-927b27a4a774 req-0fa3866c-5f3e-48f7-9ddf-fb82193c03a2 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-unplugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:25:27 user nova-compute[75342]: WARNING nova.compute.manager [req-ea5aba6c-fcdc-4b16-a68b-927b27a4a774 req-0fa3866c-5f3e-48f7-9ddf-fb82193c03a2 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received unexpected event network-vif-unplugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:25:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Instance destroyed successfully.
Nov 16 18:25:27 user nova-compute[75342]: DEBUG nova.compute.manager [req-7e1613bd-89df-4570-a4d6-a8ee4828d8d4 req-cd951bfa-c4b1-49fb-a132-c02de6807fdc service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-changed-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:27 user nova-compute[75342]: DEBUG nova.compute.manager [req-7e1613bd-89df-4570-a4d6-a8ee4828d8d4 req-cd951bfa-c4b1-49fb-a132-c02de6807fdc service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Refreshing instance network info cache due to event network-changed-e421c3fa-c93c-486e-9658-a24ae8089927. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:25:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7e1613bd-89df-4570-a4d6-a8ee4828d8d4 req-cd951bfa-c4b1-49fb-a132-c02de6807fdc service nova] Acquiring lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:25:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7e1613bd-89df-4570-a4d6-a8ee4828d8d4 req-cd951bfa-c4b1-49fb-a132-c02de6807fdc service nova] Acquired lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:25:27 user nova-compute[75342]: DEBUG nova.network.neutron [req-7e1613bd-89df-4570-a4d6-a8ee4828d8d4 req-cd951bfa-c4b1-49fb-a132-c02de6807fdc service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Refreshing network info cache for port e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:25:28 user nova-compute[75342]: DEBUG nova.network.neutron [req-7e1613bd-89df-4570-a4d6-a8ee4828d8d4 req-cd951bfa-c4b1-49fb-a132-c02de6807fdc service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updated VIF entry in instance network info cache for port e421c3fa-c93c-486e-9658-a24ae8089927. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:25:28 user nova-compute[75342]: DEBUG nova.network.neutron [req-7e1613bd-89df-4570-a4d6-a8ee4828d8d4 req-cd951bfa-c4b1-49fb-a132-c02de6807fdc service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updating instance_info_cache with network_info: [{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:25:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7e1613bd-89df-4570-a4d6-a8ee4828d8d4 req-cd951bfa-c4b1-49fb-a132-c02de6807fdc service nova] Releasing lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:25:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-0a39616d-d0cd-43d3-a88a-45ee8bc49915 req-0ed51fd6-96b3-4d81-b26a-46696d3f27a6 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0a39616d-d0cd-43d3-a88a-45ee8bc49915 req-0ed51fd6-96b3-4d81-b26a-46696d3f27a6 service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0a39616d-d0cd-43d3-a88a-45ee8bc49915 req-0ed51fd6-96b3-4d81-b26a-46696d3f27a6 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0a39616d-d0cd-43d3-a88a-45ee8bc49915 req-0ed51fd6-96b3-4d81-b26a-46696d3f27a6 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-0a39616d-d0cd-43d3-a88a-45ee8bc49915 req-0ed51fd6-96b3-4d81-b26a-46696d3f27a6 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:25:29 user nova-compute[75342]: WARNING nova.compute.manager [req-0a39616d-d0cd-43d3-a88a-45ee8bc49915 req-0ed51fd6-96b3-4d81-b26a-46696d3f27a6 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received unexpected event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with vm_state rescued and task_state unrescuing.
Nov 16 18:25:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-dd18ed45-89cc-4c08-b5b7-1d066044c024 req-c3ee5b94-5b93-4e88-b18a-eef7a5bdaf2b service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-changed-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG nova.compute.manager [req-dd18ed45-89cc-4c08-b5b7-1d066044c024 req-c3ee5b94-5b93-4e88-b18a-eef7a5bdaf2b service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Refreshing instance network info cache due to event network-changed-e421c3fa-c93c-486e-9658-a24ae8089927. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dd18ed45-89cc-4c08-b5b7-1d066044c024 req-c3ee5b94-5b93-4e88-b18a-eef7a5bdaf2b service nova] Acquiring lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dd18ed45-89cc-4c08-b5b7-1d066044c024 req-c3ee5b94-5b93-4e88-b18a-eef7a5bdaf2b service nova] Acquired lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:25:29 user nova-compute[75342]: DEBUG nova.network.neutron [req-dd18ed45-89cc-4c08-b5b7-1d066044c024 req-c3ee5b94-5b93-4e88-b18a-eef7a5bdaf2b service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Refreshing network info cache for port e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:25:30 user nova-compute[75342]: DEBUG nova.network.neutron [req-dd18ed45-89cc-4c08-b5b7-1d066044c024 req-c3ee5b94-5b93-4e88-b18a-eef7a5bdaf2b service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updated VIF entry in instance network info cache for port e421c3fa-c93c-486e-9658-a24ae8089927. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:25:30 user nova-compute[75342]: DEBUG nova.network.neutron [req-dd18ed45-89cc-4c08-b5b7-1d066044c024 req-c3ee5b94-5b93-4e88-b18a-eef7a5bdaf2b service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updating instance_info_cache with network_info: [{"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:25:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-dd18ed45-89cc-4c08-b5b7-1d066044c024 req-c3ee5b94-5b93-4e88-b18a-eef7a5bdaf2b service nova] Releasing lock "refresh_cache-5edd2a74-89b9-4163-b452-d491be30059b" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG nova.compute.manager [None req-d26c1f85-2acf-4f78-b619-672a9e3a0eb8 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:25:31 user nova-compute[75342]: WARNING nova.compute.manager [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received unexpected event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with vm_state active and task_state None.
Nov 16 18:25:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG nova.compute.manager [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:25:31 user nova-compute[75342]: WARNING nova.compute.manager [req-754132e4-1569-4782-823a-42b145465dce req-f231dd21-b3fd-4c19-871e-af301ee6efc5 service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received unexpected event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with vm_state active and task_state None.
Nov 16 18:25:31 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 is timed out.
Nov 16 18:25:31 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Successfully detached device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the live domain config.
Nov 16 18:25:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsiFveEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:25:31 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f79d75a-f36a-4d04-a309-7c77989e37f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:25:31 user nova-compute[75342]: No targets found.
Nov 16 18:25:31 user nova-compute[75342]: iSNS:
Nov 16 18:25:31 user nova-compute[75342]: No targets found.
Nov 16 18:25:31 user nova-compute[75342]: STATIC:
Nov 16 18:25:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb
Nov 16 18:25:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:25:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:25:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97
Nov 16 18:25:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:25:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:25:31 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d
Nov 16 18:25:31 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:25:31 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:25:31 user nova-compute[75342]: FIRMWARE:
Nov 16 18:25:31 user nova-compute[75342]: No targets found.
Nov 16 18:25:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:25:31 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:25:31 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2030f466-ed0e-44b6-946e-5088792b2e9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9010650-d63e-48b8-90f0-1b0ce26b2d08]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:25:31 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:25:31 user nova-compute[75342]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 (non-flash)
Nov 16 18:25:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:25:31 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:25:31 user nova-compute[75342]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 (non-flash)
Nov 16 18:25:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c83c8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97'): ({'sdd'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Removing single pathed devices sdd {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6bc166-c8de-47b1-bdaf-de6f938776af]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[baafac1d-0fb1-4e10-89ff-7994128abbf7]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Flushing IO for device /dev/sdd {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[23db8ac1-c41d-4874-9ed3-0cbd8d9552bb]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac845786-6447-4f03-9f1a-d9791e21ad75]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[72058b82-87e3-4b46-9fde-f5fdf753a2ff]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0d1eab-846b-41dc-b011-a5365e164ec4]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97, portal: 172.16.0.220,3260]
Nov 16 18:25:31 user nova-compute[75342]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97, portal: 172.16.0.220,3260] successful.
Nov 16 18:25:31 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c11c8476-84df-4ede-b792-8df0e7f20b97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c2dc7d-8552-414f-8d00-1aba799c538f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== disconnect_volume: return (319ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:25:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:25:32 user nova-compute[75342]: DEBUG nova.objects.instance [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:25:32 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-94c6fe27-1275-4ef1-b645-b7444e4dc61f tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.599s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-3cd008e5-6766-4144-95a0-4921c685abd2 req-bdeb95e8-1486-4c5a-8a15-f4c03c7e5dc2 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-changed-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-3cd008e5-6766-4144-95a0-4921c685abd2 req-bdeb95e8-1486-4c5a-8a15-f4c03c7e5dc2 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Refreshing instance network info cache due to event network-changed-837a559f-90f1-4cf9-a8b2-318a064bba08. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3cd008e5-6766-4144-95a0-4921c685abd2 req-bdeb95e8-1486-4c5a-8a15-f4c03c7e5dc2 service nova] Acquiring lock "refresh_cache-62134cad-732d-4a9d-b385-68a4317d3a72" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3cd008e5-6766-4144-95a0-4921c685abd2 req-bdeb95e8-1486-4c5a-8a15-f4c03c7e5dc2 service nova] Acquired lock "refresh_cache-62134cad-732d-4a9d-b385-68a4317d3a72" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG nova.network.neutron [req-3cd008e5-6766-4144-95a0-4921c685abd2 req-bdeb95e8-1486-4c5a-8a15-f4c03c7e5dc2 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Refreshing network info cache for port 837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "62134cad-732d-4a9d-b385-68a4317d3a72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "62134cad-732d-4a9d-b385-68a4317d3a72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:39 user nova-compute[75342]: INFO nova.compute.manager [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Terminating instance
Nov 16 18:25:39 user nova-compute[75342]: DEBUG nova.compute.manager [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG nova.network.neutron [req-3cd008e5-6766-4144-95a0-4921c685abd2 req-bdeb95e8-1486-4c5a-8a15-f4c03c7e5dc2 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Updated VIF entry in instance network info cache for port 837a559f-90f1-4cf9-a8b2-318a064bba08. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG nova.network.neutron [req-3cd008e5-6766-4144-95a0-4921c685abd2 req-bdeb95e8-1486-4c5a-8a15-f4c03c7e5dc2 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Updating instance_info_cache with network_info: [{"id": "837a559f-90f1-4cf9-a8b2-318a064bba08", "address": "fa:16:3e:94:f8:04", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837a559f-90", "ovs_interfaceid": "837a559f-90f1-4cf9-a8b2-318a064bba08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3cd008e5-6766-4144-95a0-4921c685abd2 req-bdeb95e8-1486-4c5a-8a15-f4c03c7e5dc2 service nova] Releasing lock "refresh_cache-62134cad-732d-4a9d-b385-68a4317d3a72" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-c66fc5cd-67b3-4af6-8b02-fda6235ed258 req-10a50e3d-0848-4e38-9676-677ab633a6e9 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-vif-unplugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c66fc5cd-67b3-4af6-8b02-fda6235ed258 req-10a50e3d-0848-4e38-9676-677ab633a6e9 service nova] Acquiring lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c66fc5cd-67b3-4af6-8b02-fda6235ed258 req-10a50e3d-0848-4e38-9676-677ab633a6e9 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c66fc5cd-67b3-4af6-8b02-fda6235ed258 req-10a50e3d-0848-4e38-9676-677ab633a6e9 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-c66fc5cd-67b3-4af6-8b02-fda6235ed258 req-10a50e3d-0848-4e38-9676-677ab633a6e9 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] No waiting events found dispatching network-vif-unplugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG nova.compute.manager [req-c66fc5cd-67b3-4af6-8b02-fda6235ed258 req-10a50e3d-0848-4e38-9676-677ab633a6e9 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-vif-unplugged-837a559f-90f1-4cf9-a8b2-318a064bba08 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Instance destroyed successfully.
Nov 16 18:25:40 user nova-compute[75342]: DEBUG nova.objects.instance [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'resources' on Instance uuid 62134cad-732d-4a9d-b385-68a4317d3a72 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-226371880',display_name='tempest-AttachVolumeNegativeTest-server-226371880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-226371880',id=46,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNeyKirb4irYk6lfp6az3rTYdJ7Skka0R7T404rm+cKDogaC7CuslKzVwP5lQgibgx99SQATy1Meh5lEVyMv129TpF/35EhDmIb9fGCZYFrG2Fv91+9p+Cd4a9AntlAXA==',key_name='tempest-keypair-116861489',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:23:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-ruzxdy09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=62134cad-732d-4a9d-b385-68a4317d3a72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "837a559f-90f1-4cf9-a8b2-318a064bba08", "address": "fa:16:3e:94:f8:04", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837a559f-90", "ovs_interfaceid": "837a559f-90f1-4cf9-a8b2-318a064bba08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "837a559f-90f1-4cf9-a8b2-318a064bba08", "address": "fa:16:3e:94:f8:04", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837a559f-90", "ovs_interfaceid": "837a559f-90f1-4cf9-a8b2-318a064bba08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:f8:04,bridge_name='br-int',has_traffic_filtering=True,id=837a559f-90f1-4cf9-a8b2-318a064bba08,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837a559f-90') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG os_vif [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:f8:04,bridge_name='br-int',has_traffic_filtering=True,id=837a559f-90f1-4cf9-a8b2-318a064bba08,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837a559f-90') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap837a559f-90, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c492bb6-d402-4cc5-b278-be3307c9855b) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:25:40 user nova-compute[75342]: INFO os_vif [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:f8:04,bridge_name='br-int',has_traffic_filtering=True,id=837a559f-90f1-4cf9-a8b2-318a064bba08,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837a559f-90')
Nov 16 18:25:40 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Deleting instance files /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72_del
Nov 16 18:25:40 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Deletion of /opt/stack/data/nova/instances/62134cad-732d-4a9d-b385-68a4317d3a72_del complete
Nov 16 18:25:40 user nova-compute[75342]: INFO nova.compute.manager [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 16 18:25:40 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:41 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:25:41 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Took 1.53 seconds to deallocate network for instance.
Nov 16 18:25:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Acquiring lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] No waiting events found dispatching network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:25:42 user nova-compute[75342]: WARNING nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received unexpected event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 for instance with vm_state deleted and task_state None.
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Acquiring lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] No waiting events found dispatching network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:25:42 user nova-compute[75342]: WARNING nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received unexpected event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 for instance with vm_state deleted and task_state None.
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Acquiring lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] No waiting events found dispatching network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:25:42 user nova-compute[75342]: WARNING nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received unexpected event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 for instance with vm_state deleted and task_state None.
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-vif-unplugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Acquiring lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] No waiting events found dispatching network-vif-unplugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:25:42 user nova-compute[75342]: WARNING nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received unexpected event network-vif-unplugged-837a559f-90f1-4cf9-a8b2-318a064bba08 for instance with vm_state deleted and task_state None.
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Acquiring lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] Lock "62134cad-732d-4a9d-b385-68a4317d3a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] No waiting events found dispatching network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:25:42 user nova-compute[75342]: WARNING nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received unexpected event network-vif-plugged-837a559f-90f1-4cf9-a8b2-318a064bba08 for instance with vm_state deleted and task_state None.
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.manager [req-1ce6a718-f007-4eae-a922-ad4370f152b2 req-30848cd5-8682-4e7f-8303-7c835dc89dd0 service nova] [instance: 62134cad-732d-4a9d-b385-68a4317d3a72] Received event network-vif-deleted-837a559f-90f1-4cf9-a8b2-318a064bba08 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:42 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Deleted allocations for instance 62134cad-732d-4a9d-b385-68a4317d3a72
Nov 16 18:25:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-ba559737-4e1c-4bff-af5c-93ddd00cb721 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "62134cad-732d-4a9d-b385-68a4317d3a72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.658s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:25:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 18:25:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] There are 0 instances to clean {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 18:25:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:25:51 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:25:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:25:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:25:52 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:25:52 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:25:52 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 18:25:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:54 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:25:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:25:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:25:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:25:58 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:25:59 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:25:59 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8202MB free_disk=24.872894287109375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 5edd2a74-89b9-4163-b452-d491be30059b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 01b66315-e6be-4f03-958c-514222a7848e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 7399ebfd-2764-47f1-90fe-d20079dfd171 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing inventories for resource provider fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating ProviderTree inventory for provider fdd6b940-75a0-4315-8416-79157aaeea59 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing aggregate associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, aggregates: None {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing trait associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, traits: COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:25:59 user nova-compute[75342]: INFO nova.compute.manager [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Detaching volume 883de896-bc61-4f55-aa19-abcc569d186d
Nov 16 18:25:59 user nova-compute[75342]: INFO nova.virt.block_device [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Attempting to driver detach volume 883de896-bc61-4f55-aa19-abcc569d186d from mountpoint /dev/vdb
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Attempting to detach device vdb from instance 5edd2a74-89b9-4163-b452-d491be30059b from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:25:59 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:25:59 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:25:59 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:25:59 user nova-compute[75342]:   <serial>883de896-bc61-4f55-aa19-abcc569d186d</serial>
Nov 16 18:25:59 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:25:59 user nova-compute[75342]: </disk>
Nov 16 18:25:59 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:25:59 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Successfully detached device vdb from instance 5edd2a74-89b9-4163-b452-d491be30059b from the persistent domain config.
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5edd2a74-89b9-4163-b452-d491be30059b from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:25:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:25:59 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:25:59 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:25:59 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:25:59 user nova-compute[75342]:   <serial>883de896-bc61-4f55-aa19-abcc569d186d</serial>
Nov 16 18:25:59 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:25:59 user nova-compute[75342]: </disk>
Nov 16 18:25:59 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:26:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:26:01 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:01 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:26:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:26:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:26:01 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:26:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updating instance_info_cache with network_info: [{"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:26:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:26:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:26:02 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:02 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:02 user nova-compute[75342]: DEBUG nova.objects.instance [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:03 user nova-compute[75342]: INFO nova.compute.manager [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attaching volume 045aff0d-7724-4755-8522-ae306c8176ca to /dev/vdb
Nov 16 18:26:03 user nova-compute[75342]: DEBUG os_brick.utils [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cda425-93f4-409e-9b77-825a3faebf97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5146945b-a168-43ac-bd84-e596240b09b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a2ac40-36d5-43c0-bca7-d9601d9e97ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f183c8-5c81-439c-81f0-c58e29e8ee51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:26:03 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:26:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb8e4c-8fe0-4d63-9c56-76d6672a0cc3]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG os_brick.utils [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updating existing volume attachment record: 9f11a049-8100-4893-944e-636b975246dd {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:26:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-25a2c182-be8d-4837-8815-198f7fd8c5a7 req-f51a8060-30af-45ce-91be-4c4eec2cba34 service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Received event network-changed-0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-25a2c182-be8d-4837-8815-198f7fd8c5a7 req-f51a8060-30af-45ce-91be-4c4eec2cba34 service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Refreshing instance network info cache due to event network-changed-0abf9549-d158-43b5-a957-c948cad17d00. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-25a2c182-be8d-4837-8815-198f7fd8c5a7 req-f51a8060-30af-45ce-91be-4c4eec2cba34 service nova] Acquiring lock "refresh_cache-01b66315-e6be-4f03-958c-514222a7848e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-25a2c182-be8d-4837-8815-198f7fd8c5a7 req-f51a8060-30af-45ce-91be-4c4eec2cba34 service nova] Acquired lock "refresh_cache-01b66315-e6be-4f03-958c-514222a7848e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG nova.network.neutron [req-25a2c182-be8d-4837-8815-198f7fd8c5a7 req-f51a8060-30af-45ce-91be-4c4eec2cba34 service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Refreshing network info cache for port 0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "01b66315-e6be-4f03-958c-514222a7848e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG nova.objects.instance [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lazy-loading 'flavor' on Instance uuid 01b66315-e6be-4f03-958c-514222a7848e {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Ignoring supplied device name: /dev/vdb
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "01b66315-e6be-4f03-958c-514222a7848e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:05 user nova-compute[75342]: INFO nova.compute.manager [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Attaching volume fac59f48-4d0f-4efe-bd76-f147bce0d76c to /dev/vdb
Nov 16 18:26:05 user nova-compute[75342]: DEBUG nova.network.neutron [req-25a2c182-be8d-4837-8815-198f7fd8c5a7 req-f51a8060-30af-45ce-91be-4c4eec2cba34 service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Updated VIF entry in instance network info cache for port 0abf9549-d158-43b5-a957-c948cad17d00. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG nova.network.neutron [req-25a2c182-be8d-4837-8815-198f7fd8c5a7 req-f51a8060-30af-45ce-91be-4c4eec2cba34 service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Updating instance_info_cache with network_info: [{"id": "0abf9549-d158-43b5-a957-c948cad17d00", "address": "fa:16:3e:0b:ec:23", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0abf9549-d1", "ovs_interfaceid": "0abf9549-d158-43b5-a957-c948cad17d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-25a2c182-be8d-4837-8815-198f7fd8c5a7 req-f51a8060-30af-45ce-91be-4c4eec2cba34 service nova] Releasing lock "refresh_cache-01b66315-e6be-4f03-958c-514222a7848e" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG os_brick.utils [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edf3646-cc71-40b0-be8c-d052cb7c7ca8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b8b2e8-7312-43a9-8a56-c8d3f0aaa926]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b10be0-4bfc-4304-a4ee-ce9e854952c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc01c48-2b41-40d2-9182-9d6116da5e58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:26:05 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:26:05 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcbdc0d-24e7-4697-acfe-89f0e6383952]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG os_brick.utils [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:05 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Updating existing volume attachment record: ecc882ca-800d-4af5-8003-e989bef0977e {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:26:06 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:06 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLitBuvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:08 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:08 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:08 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d67dab-1478-4840-b68d-ce86904dda48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:26:08 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0648ab0d-438c-4da6-b5ae-488e1b67632f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca] added
Nov 16 18:26:08 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe7fd73-6374-4da0-a27a-57631d7decb7]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[949d985c-c028-4be5-9f4f-23d6896a0d4e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLitBuvd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLitBuvd" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ecc52a-3ed0-4b9c-888a-b34fe2451c35]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PLitBuvd'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d23696-55af-4991-bad5-cc0eb8030feb]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f07668-3e78-4465-a4fb-8019fa9eec7e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:08 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:08 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:08 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:08 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a0cd61-52f2-4053-a968-bf7cb4f9f240]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca, portal: 172.16.0.220,3260]
Nov 16 18:26:08 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca, portal: 172.16.0.220,3260] successful.
Nov 16 18:26:08 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[347bef63-3df1-4a88-81c4-ff0a043b3886]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b924c82-5ad3-43dc-8f4e-5737b4dc0e8a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:08 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:08 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:08 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:08 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:08 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:08 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c827cda7-286f-4fdc-8e54-a949530dcdba]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLitBuvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26631633930323837', 'path': '/dev/sdd'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631633930323837', 'path': '/dev/sdd'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.objects.instance [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:26:09 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:26:09 user nova-compute[75342]:   <source dev="/dev/sdd"/>
Nov 16 18:26:09 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:26:09 user nova-compute[75342]:   <serial>045aff0d-7724-4755-8522-ae306c8176ca</serial>
Nov 16 18:26:09 user nova-compute[75342]: </disk>
Nov 16 18:26:09 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-f6ef7538-af24-4404-9a52-70e6d64e2d9a req-e18a937b-fc2d-49de-b866-fd91d74d9546 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received event network-changed-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-f6ef7538-af24-4404-9a52-70e6d64e2d9a req-e18a937b-fc2d-49de-b866-fd91d74d9546 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Refreshing instance network info cache due to event network-changed-2449ec97-62ae-4f59-a0be-5af2ec7bc250. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f6ef7538-af24-4404-9a52-70e6d64e2d9a req-e18a937b-fc2d-49de-b866-fd91d74d9546 service nova] Acquiring lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f6ef7538-af24-4404-9a52-70e6d64e2d9a req-e18a937b-fc2d-49de-b866-fd91d74d9546 service nova] Acquired lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-f6ef7538-af24-4404-9a52-70e6d64e2d9a req-e18a937b-fc2d-49de-b866-fd91d74d9546 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Refreshing network info cache for port 2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No VIF found with MAC fa:16:3e:a1:d6:05, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "7399ebfd-2764-47f1-90fe-d20079dfd171" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-f6ef7538-af24-4404-9a52-70e6d64e2d9a req-e18a937b-fc2d-49de-b866-fd91d74d9546 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Updated VIF entry in instance network info cache for port 2449ec97-62ae-4f59-a0be-5af2ec7bc250. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-f6ef7538-af24-4404-9a52-70e6d64e2d9a req-e18a937b-fc2d-49de-b866-fd91d74d9546 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Updating instance_info_cache with network_info: [{"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG nova.objects.instance [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lazy-loading 'flavor' on Instance uuid 7399ebfd-2764-47f1-90fe-d20079dfd171 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f6ef7538-af24-4404-9a52-70e6d64e2d9a req-e18a937b-fc2d-49de-b866-fd91d74d9546 service nova] Releasing lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:26:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2dbd685c-5d1e-4a8c-b7c1-921212238908 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.981s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "7399ebfd-2764-47f1-90fe-d20079dfd171" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:10 user nova-compute[75342]: INFO nova.compute.manager [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Attaching volume 76f74108-60a0-4544-aeee-9292f9182f60 to /dev/vdb
Nov 16 18:26:10 user nova-compute[75342]: DEBUG os_brick.utils [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c579fb-e73b-4ff1-af40-467443457590]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6876f3b0-e2b5-4daf-8fb8-f8eab3ac97e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2f0913-454a-4c88-9701-f35fa28227ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[13372290-527a-4de1-bc70-5b806df072f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:26:10 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f317d5ce-fca9-4f21-92ca-1b31f8b9e6e4]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG os_brick.utils [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Updating existing volume attachment record: cbe9af59-047d-4b47-aa82-bc9eb4866af0 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfePwLha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:10 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:10 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:10 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:26:10 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dbb6a9-98dd-462d-a03a-a84540e977db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:26:11 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8004c52-6656-4b9a-9d49-66bce2ec4e0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c] added
Nov 16 18:26:11 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4840ac7-fbdd-4eaa-8ae5-ccc8eb4ec711]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdf0d22-6205-4d97-95a6-7e07cc55970e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfePwLha {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfePwLha" returned: 0 in 0.076s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab0d2d1-6097-41e9-b865-689ce595134c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MfePwLha'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1f9aa5-60cd-49f6-b45b-d71a15c13a7c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4872d8f2-452c-4eb2-8a93-8addd648a1de]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:11 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:11 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:11 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:11 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:11 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:11 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a9b6f0-ad17-452a-9807-b38f5d7472bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c, portal: 172.16.0.220,3260]
Nov 16 18:26:11 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c, portal: 172.16.0.220,3260] successful.
Nov 16 18:26:11 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[effe4c3c-07da-4819-8dc9-bf7fdd0e653d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1603dc-0c63-4571-acb4-153591d80cc8]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:11 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:11 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:11 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:11 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:11 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:11 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:11 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:11 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddcdaa8-ed99-4701-b0f5-21643156cbae]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:26:11 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfePwLha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:12 user nova-compute[75342]: INFO nova.compute.manager [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Detaching volume 045aff0d-7724-4755-8522-ae306c8176ca
Nov 16 18:26:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23066303364386134', 'path': '/dev/sde'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066303364386134', 'path': '/dev/sde'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:26:12 user nova-compute[75342]: INFO nova.virt.block_device [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attempting to driver detach volume 045aff0d-7724-4755-8522-ae306c8176ca from mountpoint /dev/vdb
Nov 16 18:26:12 user nova-compute[75342]: DEBUG nova.objects.instance [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lazy-loading 'flavor' on Instance uuid 01b66315-e6be-4f03-958c-514222a7848e {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Attempting to detach device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:26:12 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:26:12 user nova-compute[75342]:   <source dev="/dev/sdd"/>
Nov 16 18:26:12 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:26:12 user nova-compute[75342]:   <serial>045aff0d-7724-4755-8522-ae306c8176ca</serial>
Nov 16 18:26:12 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:26:12 user nova-compute[75342]: </disk>
Nov 16 18:26:12 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:26:12 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:26:12 user nova-compute[75342]:   <source dev="/dev/sde"/>
Nov 16 18:26:12 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:26:12 user nova-compute[75342]:   <serial>fac59f48-4d0f-4efe-bd76-f147bce0d76c</serial>
Nov 16 18:26:12 user nova-compute[75342]: </disk>
Nov 16 18:26:12 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:26:12 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Successfully detached device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the persistent domain config.
Nov 16 18:26:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:26:12 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:26:12 user nova-compute[75342]:   <source dev="/dev/sdd"/>
Nov 16 18:26:12 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:26:12 user nova-compute[75342]:   <serial>045aff0d-7724-4755-8522-ae306c8176ca</serial>
Nov 16 18:26:12 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:26:12 user nova-compute[75342]: </disk>
Nov 16 18:26:12 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] No VIF found with MAC fa:16:3e:0b:ec:23, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:26:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-daf5e4ef-ec08-47fb-9130-5f7caca702cd tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.357s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:26:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtOVfKRM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:15 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:15 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:15 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf050ed-286e-41f7-b165-43673174cbe0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:26:15 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff26f814-62f0-41c2-b903-78b0835ce5f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60] added
Nov 16 18:26:15 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b0448-a37c-4d90-8d52-beb47d923d1b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b08556-2cdc-429e-b2d7-df2657a1816c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtOVfKRM {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtOVfKRM" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb330418-9290-4385-9437-59c23a3e7552]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gtOVfKRM'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9488b177-d04f-417e-94bb-246c8d2e487d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a047618f-d2df-4d7e-94b6-4739ee4eec0b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:15 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:15 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[621f6729-1d32-4562-b23f-71b2b26f6a11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60, portal: 172.16.0.220,3260]
Nov 16 18:26:15 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60, portal: 172.16.0.220,3260] successful.
Nov 16 18:26:15 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[767bc018-6b86-48e1-a1d3-2f9ac872f439]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24aabad-c900-4fd2-991d-1e2f8aec781d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)
Nov 16 18:26:15 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:15 user nova-compute[75342]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)
Nov 16 18:26:15 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] HCTL ('37', '-', '-', 0) found on session 57 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3297fb-2485-43b0-8a59-5c1ea21c1747]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Searching for a device in session 57 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:26:15 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtOVfKRM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:26:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26137313132633833', 'path': '/dev/sdf'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137313132633833', 'path': '/dev/sdf'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:26:16 user nova-compute[75342]: DEBUG nova.objects.instance [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lazy-loading 'flavor' on Instance uuid 7399ebfd-2764-47f1-90fe-d20079dfd171 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:26:16 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:26:16 user nova-compute[75342]:   <source dev="/dev/sdf"/>
Nov 16 18:26:16 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:26:16 user nova-compute[75342]:   <serial>76f74108-60a0-4544-aeee-9292f9182f60</serial>
Nov 16 18:26:16 user nova-compute[75342]: </disk>
Nov 16 18:26:16 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:26:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:26:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:26:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] No VIF found with MAC fa:16:3e:97:03:8c, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:26:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c889e872-9da5-4137-881f-69884814819d tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.024s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "7399ebfd-2764-47f1-90fe-d20079dfd171" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:18 user nova-compute[75342]: INFO nova.compute.manager [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Detaching volume 76f74108-60a0-4544-aeee-9292f9182f60
Nov 16 18:26:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:18 user nova-compute[75342]: INFO nova.virt.block_device [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Attempting to driver detach volume 76f74108-60a0-4544-aeee-9292f9182f60 from mountpoint /dev/vdb
Nov 16 18:26:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Attempting to detach device vdb from instance 7399ebfd-2764-47f1-90fe-d20079dfd171 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:26:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:26:18 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:26:18 user nova-compute[75342]:   <source dev="/dev/sdf"/>
Nov 16 18:26:18 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:26:18 user nova-compute[75342]:   <serial>76f74108-60a0-4544-aeee-9292f9182f60</serial>
Nov 16 18:26:18 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:26:18 user nova-compute[75342]: </disk>
Nov 16 18:26:18 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:26:18 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Successfully detached device vdb from instance 7399ebfd-2764-47f1-90fe-d20079dfd171 from the persistent domain config.
Nov 16 18:26:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7399ebfd-2764-47f1-90fe-d20079dfd171 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:26:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:26:18 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:26:18 user nova-compute[75342]:   <source dev="/dev/sdf"/>
Nov 16 18:26:18 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:26:18 user nova-compute[75342]:   <serial>76f74108-60a0-4544-aeee-9292f9182f60</serial>
Nov 16 18:26:18 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:26:18 user nova-compute[75342]: </disk>
Nov 16 18:26:18 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:26:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7399ebfd-2764-47f1-90fe-d20079dfd171 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:26:20 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5edd2a74-89b9-4163-b452-d491be30059b is timed out.
Nov 16 18:26:20 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Successfully detached device vdb from instance 5edd2a74-89b9-4163-b452-d491be30059b from the live domain config.
Nov 16 18:26:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGqJVTAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:20 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a0f3b6-4107-4315-a86d-d854307fd26e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:26:20 user nova-compute[75342]: No targets found.
Nov 16 18:26:20 user nova-compute[75342]: iSNS:
Nov 16 18:26:20 user nova-compute[75342]: No targets found.
Nov 16 18:26:20 user nova-compute[75342]: STATIC:
Nov 16 18:26:20 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60
Nov 16 18:26:20 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:20 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:20 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb
Nov 16 18:26:20 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:20 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:20 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c
Nov 16 18:26:20 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:20 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:20 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca
Nov 16 18:26:20 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:20 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:20 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d
Nov 16 18:26:20 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:20 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:20 user nova-compute[75342]: FIRMWARE:
Nov 16 18:26:20 user nova-compute[75342]: No targets found.
Nov 16 18:26:20 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:26:20 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:26:20 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae02e16-a6f9-4662-8e30-09d332791f66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dba0177-a66c-4481-9762-db85eeca7ad1]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:20 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:20 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:20 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:20 user nova-compute[75342]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)
Nov 16 18:26:20 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d (non-flash)
Nov 16 18:26:20 user nova-compute[75342]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:20 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:20 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:20 user nova-compute[75342]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)
Nov 16 18:26:20 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c819fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a7fb85-b9d1-4a7a-8f53-838ca6428a1d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a027ba49-68fe-440b-89e2-b8a325d0fc06]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe65fb3-fa24-4d33-92d1-2c1fe3bf0fec]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbb44bf-a733-460f-ad4f-c0aac419bbef]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a971acf-e36b-4ed4-b7e8-5058b1f0fb67]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b82ff93-c676-4ab7-8e72-d1a06ad30e28]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d, portal: 172.16.0.220,3260]
Nov 16 18:26:20 user nova-compute[75342]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d, portal: 172.16.0.220,3260] successful.
Nov 16 18:26:20 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883de896-bc61-4f55-aa19-abcc569d186d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5860c855-5ea6-40fa-ace9-4dda42a86913]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] <== disconnect_volume: return (307ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:20 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:26:21 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'flavor' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8a7cf950-ae93-47ff-8bba-e0576279cd86 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.608s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "01b66315-e6be-4f03-958c-514222a7848e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:24 user nova-compute[75342]: INFO nova.compute.manager [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Detaching volume fac59f48-4d0f-4efe-bd76-f147bce0d76c
Nov 16 18:26:24 user nova-compute[75342]: INFO nova.virt.block_device [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Attempting to driver detach volume fac59f48-4d0f-4efe-bd76-f147bce0d76c from mountpoint /dev/vdb
Nov 16 18:26:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Attempting to detach device vdb from instance 01b66315-e6be-4f03-958c-514222a7848e from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:26:24 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:26:24 user nova-compute[75342]:   <source dev="/dev/sde"/>
Nov 16 18:26:24 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:26:24 user nova-compute[75342]:   <serial>fac59f48-4d0f-4efe-bd76-f147bce0d76c</serial>
Nov 16 18:26:24 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:26:24 user nova-compute[75342]: </disk>
Nov 16 18:26:24 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "01b66315-e6be-4f03-958c-514222a7848e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:24 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Successfully detached device vdb from instance 01b66315-e6be-4f03-958c-514222a7848e from the persistent domain config.
Nov 16 18:26:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01b66315-e6be-4f03-958c-514222a7848e from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:26:24 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:26:24 user nova-compute[75342]:   <source dev="/dev/sde"/>
Nov 16 18:26:24 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:26:24 user nova-compute[75342]:   <serial>fac59f48-4d0f-4efe-bd76-f147bce0d76c</serial>
Nov 16 18:26:24 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:26:24 user nova-compute[75342]: </disk>
Nov 16 18:26:24 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01b66315-e6be-4f03-958c-514222a7848e {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 01b66315-e6be-4f03-958c-514222a7848e {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 7399ebfd-2764-47f1-90fe-d20079dfd171 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "5edd2a74-89b9-4163-b452-d491be30059b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "01b66315-e6be-4f03-958c-514222a7848e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "7399ebfd-2764-47f1-90fe-d20079dfd171" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "5edd2a74-89b9-4163-b452-d491be30059b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:31 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:31 user nova-compute[75342]: INFO nova.compute.manager [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Detaching volume 0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb
Nov 16 18:26:31 user nova-compute[75342]: INFO nova.virt.block_device [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Attempting to driver detach volume 0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb from mountpoint /dev/vdb
Nov 16 18:26:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Attempting to detach device vdb from instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:26:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:26:31 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:26:31 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:26:31 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:26:31 user nova-compute[75342]:   <serial>0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb</serial>
Nov 16 18:26:31 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:26:31 user nova-compute[75342]: </disk>
Nov 16 18:26:31 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:26:31 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully detached device vdb from instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d from the persistent domain config.
Nov 16 18:26:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:26:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:26:31 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:26:31 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:26:31 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:26:31 user nova-compute[75342]:   <serial>0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb</serial>
Nov 16 18:26:31 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:26:31 user nova-compute[75342]: </disk>
Nov 16 18:26:31 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:26:31 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:26:33 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 is timed out.
Nov 16 18:26:33 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Successfully detached device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the live domain config.
Nov 16 18:26:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLitBuvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:33 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eecb7c-7570-4e32-b9d8-f2bff256e601]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:26:33 user nova-compute[75342]: No targets found.
Nov 16 18:26:33 user nova-compute[75342]: iSNS:
Nov 16 18:26:33 user nova-compute[75342]: No targets found.
Nov 16 18:26:33 user nova-compute[75342]: STATIC:
Nov 16 18:26:33 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60
Nov 16 18:26:33 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:33 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:33 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb
Nov 16 18:26:33 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:33 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:33 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c
Nov 16 18:26:33 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:33 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:33 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca
Nov 16 18:26:33 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:33 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:33 user nova-compute[75342]: FIRMWARE:
Nov 16 18:26:33 user nova-compute[75342]: No targets found.
Nov 16 18:26:33 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:26:33 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:26:33 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2271322e-58da-447d-8158-516de813f5ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f231be-205b-406d-82d7-d0ce73e95075]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:33 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:33 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:33 user nova-compute[75342]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)
Nov 16 18:26:33 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:33 user nova-compute[75342]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca (non-flash)
Nov 16 18:26:33 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:33 user nova-compute[75342]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)
Nov 16 18:26:33 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a468f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca'): ({'sdd'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Removing single pathed devices sdd {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a317dc-1e89-4b98-a910-cb5e371a9061]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fdf735-1ef4-49ec-95c2-f13e347051c3]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Flushing IO for device /dev/sdd {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41ea744-96e1-47f2-8007-f1188eb3341b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab02fb5-9c12-4117-8fbd-7363b37f743f]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] SCSI volumes sdd have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86fe6d2-555b-44d5-980a-5bd8e582c0a4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae04d204-8d8f-4af8-bbee-d9ef48cbea30]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca, portal: 172.16.0.220,3260]
Nov 16 18:26:33 user nova-compute[75342]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca, portal: 172.16.0.220,3260] successful.
Nov 16 18:26:33 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045aff0d-7724-4755-8522-ae306c8176ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adf5d76-4e68-4af2-ba69-15adbc488e65]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== disconnect_volume: return (301ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:33 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:26:34 user nova-compute[75342]: DEBUG nova.objects.instance [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-5a56caed-29f0-4faa-a863-d34b325de5db tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.956s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.199s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:34 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:26:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:39 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7399ebfd-2764-47f1-90fe-d20079dfd171 is timed out.
Nov 16 18:26:39 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Successfully detached device vdb from instance 7399ebfd-2764-47f1-90fe-d20079dfd171 from the live domain config.
Nov 16 18:26:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtOVfKRM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:39 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0118e285-6df6-4dc6-ba7e-d5b54b668a86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:26:39 user nova-compute[75342]: No targets found.
Nov 16 18:26:39 user nova-compute[75342]: iSNS:
Nov 16 18:26:39 user nova-compute[75342]: No targets found.
Nov 16 18:26:39 user nova-compute[75342]: STATIC:
Nov 16 18:26:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60
Nov 16 18:26:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb
Nov 16 18:26:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:39 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c
Nov 16 18:26:39 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:39 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:39 user nova-compute[75342]: FIRMWARE:
Nov 16 18:26:39 user nova-compute[75342]: No targets found.
Nov 16 18:26:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:26:39 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:26:39 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[208e0c66-647b-45ef-8303-38864f50fc19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc76440e-aa59-4fa4-8d94-bae59b9496e3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:39 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:39 user nova-compute[75342]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)
Nov 16 18:26:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:39 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:39 user nova-compute[75342]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 (non-flash)
Nov 16 18:26:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c85580d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60'): ({'sdf'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Removing single pathed devices sdf {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f7473e-1932-4aa4-b0ed-3288c923e4dd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0948b1-39d3-45bd-83a6-ed8e63a4e55a]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Flushing IO for device /dev/sdf {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d636ffca-9094-4dbd-9132-ad20b4e30611]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cab125-4b7d-450b-b8e7-b34834a857b3]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] SCSI volumes sdf have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67eebd7-8c95-4d3d-9abc-53e504332e62]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[327134bb-b4d4-4745-8ef7-241842445011]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60, portal: 172.16.0.220,3260]
Nov 16 18:26:39 user nova-compute[75342]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60, portal: 172.16.0.220,3260] successful.
Nov 16 18:26:39 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f74108-60a0-4544-aeee-9292f9182f60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f87a53-1fcb-4aad-ba9d-16a7612d8c39]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] <== disconnect_volume: return (325ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:39 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:26:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:40 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lazy-loading 'flavor' on Instance uuid 7399ebfd-2764-47f1-90fe-d20079dfd171 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3b9dab46-064f-4b7c-8176-3cde0c2eb26e tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.662s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.542s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:40 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:44 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01b66315-e6be-4f03-958c-514222a7848e is timed out.
Nov 16 18:26:44 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Successfully detached device vdb from instance 01b66315-e6be-4f03-958c-514222a7848e from the live domain config.
Nov 16 18:26:44 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:26:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfePwLha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:44 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:44 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8dc52b-a047-4fc9-aba0-6b08b82be39a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:26:44 user nova-compute[75342]: No targets found.
Nov 16 18:26:44 user nova-compute[75342]: iSNS:
Nov 16 18:26:44 user nova-compute[75342]: No targets found.
Nov 16 18:26:44 user nova-compute[75342]: STATIC:
Nov 16 18:26:44 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb
Nov 16 18:26:44 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:44 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:44 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c
Nov 16 18:26:44 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:44 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:44 user nova-compute[75342]: FIRMWARE:
Nov 16 18:26:44 user nova-compute[75342]: No targets found.
Nov 16 18:26:44 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:26:44 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:26:44 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:26:44 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:26:44 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d7e4db-d36a-4209-8080-180d61507f9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[07562c51-062c-4fbb-85e1-cb5fd760f7b3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:45 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:45 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:45 user nova-compute[75342]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c (non-flash)
Nov 16 18:26:45 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a468ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c'): ({'sde'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Removing single pathed devices sde {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[86507b01-10ac-4c27-afe7-1e9a70799530]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41bb0db-2327-401d-9e41-97c1f3504fec]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Flushing IO for device /dev/sde {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d38d3b-7faf-436b-976c-d3c294ca3d45]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f335ca6f-48f3-443c-9cbd-dc593cffa1da]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] SCSI volumes sde have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ccfcf6-ab0e-4d7c-8814-134c6243149d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --logout" returned: 0 in 0.103s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff90c66c-8de6-49f8-a67c-e3bfa71416c9]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c, portal: 172.16.0.220,3260]
Nov 16 18:26:45 user nova-compute[75342]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c, portal: 172.16.0.220,3260] successful.
Nov 16 18:26:45 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1171e32f-8f57-44ea-abf5-e33b70f565d0]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] <== disconnect_volume: return (343ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:26:45 user nova-compute[75342]: DEBUG nova.objects.instance [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lazy-loading 'flavor' on Instance uuid 01b66315-e6be-4f03-958c-514222a7848e {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0847c040-3c2f-452d-a4b6-02139580ddad tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.654s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.551s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "01b66315-e6be-4f03-958c-514222a7848e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:46 user nova-compute[75342]: INFO nova.compute.manager [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Terminating instance
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.compute.manager [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-84ae515d-88a2-469a-852e-ad5c6e5bcf5e req-8e6b023c-8a39-41ae-adb8-8379628133fc service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Received event network-vif-unplugged-0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-84ae515d-88a2-469a-852e-ad5c6e5bcf5e req-8e6b023c-8a39-41ae-adb8-8379628133fc service nova] Acquiring lock "01b66315-e6be-4f03-958c-514222a7848e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-84ae515d-88a2-469a-852e-ad5c6e5bcf5e req-8e6b023c-8a39-41ae-adb8-8379628133fc service nova] Lock "01b66315-e6be-4f03-958c-514222a7848e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-84ae515d-88a2-469a-852e-ad5c6e5bcf5e req-8e6b023c-8a39-41ae-adb8-8379628133fc service nova] Lock "01b66315-e6be-4f03-958c-514222a7848e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-84ae515d-88a2-469a-852e-ad5c6e5bcf5e req-8e6b023c-8a39-41ae-adb8-8379628133fc service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] No waiting events found dispatching network-vif-unplugged-0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.compute.manager [req-84ae515d-88a2-469a-852e-ad5c6e5bcf5e req-8e6b023c-8a39-41ae-adb8-8379628133fc service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Received event network-vif-unplugged-0abf9549-d158-43b5-a957-c948cad17d00 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:46 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Instance destroyed successfully.
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.objects.instance [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lazy-loading 'resources' on Instance uuid 01b66315-e6be-4f03-958c-514222a7848e {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:24:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-97436471',display_name='tempest-VolumesSnapshotTestJSON-instance-97436471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-97436471',id=47,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaLE/YBTX0kw5WyXCIsJvKw7bBv5i9rM53irzP1/QE1EQR0Zea8cTVPl1LsEIT66qIOSwTbtjspLThlRQFeHEBzlLviBhsuIHYYfYUT7bEaSeKu6yFrhnMq4/8zG9mvkg==',key_name='tempest-keypair-1136286171',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:24:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afab8ca8fb0e4810aff37187498d3855',ramdisk_id='',reservation_id='r-7vfei6mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-31047705',owner_user_name='tempest-VolumesSnapshotTestJSON-31047705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48aea12e1e7c40f69b90ce451a9bf745',uuid=01b66315-e6be-4f03-958c-514222a7848e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0abf9549-d158-43b5-a957-c948cad17d00", "address": "fa:16:3e:0b:ec:23", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0abf9549-d1", "ovs_interfaceid": "0abf9549-d158-43b5-a957-c948cad17d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converting VIF {"id": "0abf9549-d158-43b5-a957-c948cad17d00", "address": "fa:16:3e:0b:ec:23", "network": {"id": "fe8bebe0-0c78-4566-b1be-4a75ad13101d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-417331343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afab8ca8fb0e4810aff37187498d3855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0abf9549-d1", "ovs_interfaceid": "0abf9549-d158-43b5-a957-c948cad17d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=0abf9549-d158-43b5-a957-c948cad17d00,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0abf9549-d1') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_vif [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=0abf9549-d158-43b5-a957-c948cad17d00,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0abf9549-d1') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0abf9549-d1, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9f96983-183c-4399-8654-eeedb8efec5d) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:26:46 user nova-compute[75342]: INFO os_vif [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=0abf9549-d158-43b5-a957-c948cad17d00,network=Network(fe8bebe0-0c78-4566-b1be-4a75ad13101d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0abf9549-d1')
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfePwLha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:46 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e05955-c84a-4167-a8b9-a45d6ad2d2fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:26:46 user nova-compute[75342]: No targets found.
Nov 16 18:26:46 user nova-compute[75342]: iSNS:
Nov 16 18:26:46 user nova-compute[75342]: No targets found.
Nov 16 18:26:46 user nova-compute[75342]: STATIC:
Nov 16 18:26:46 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb
Nov 16 18:26:46 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:46 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:46 user nova-compute[75342]: FIRMWARE:
Nov 16 18:26:46 user nova-compute[75342]: No targets found.
Nov 16 18:26:46 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:26:46 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:26:46 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fac59f48-4d0f-4efe-bd76-f147bce0d76c', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[46479612-93e3-4e26-aa16-ff96842558f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca85b276-929c-4581-8bd7-3c96835f1a5b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:46 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:46 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6d13d7be0>, {}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Disconnecting from: [] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] <== disconnect_volume: return (67ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:26:46 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Deleting instance files /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e_del
Nov 16 18:26:46 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Deletion of /opt/stack/data/nova/instances/01b66315-e6be-4f03-958c-514222a7848e_del complete
Nov 16 18:26:46 user nova-compute[75342]: INFO nova.compute.manager [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 16 18:26:46 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:26:46 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 01b66315-e6be-4f03-958c-514222a7848e] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:26:47 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:26:47 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Took 0.91 seconds to deallocate network for instance.
Nov 16 18:26:47 user nova-compute[75342]: WARNING nova.volume.cinder [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Attachment ecc882ca-800d-4af5-8003-e989bef0977e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ecc882ca-800d-4af5-8003-e989bef0977e. (HTTP 404) (Request-ID: req-99b6f922-21ff-4a3e-9e80-23ba3a1962eb)
Nov 16 18:26:47 user nova-compute[75342]: INFO nova.compute.manager [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Took 0.03 seconds to detach 1 volumes for instance.
Nov 16 18:26:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:47 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:48 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:26:48 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:26:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:48 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Deleted allocations for instance 01b66315-e6be-4f03-958c-514222a7848e
Nov 16 18:26:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-654cd479-1404-4954-90fd-fb1feb8130e2 tempest-VolumesSnapshotTestJSON-31047705 tempest-VolumesSnapshotTestJSON-31047705-project-member] Lock "01b66315-e6be-4f03-958c-514222a7848e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.335s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "01b66315-e6be-4f03-958c-514222a7848e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 23.385s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:48 user nova-compute[75342]: INFO nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 01b66315-e6be-4f03-958c-514222a7848e] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 16 18:26:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "01b66315-e6be-4f03-958c-514222a7848e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-ebad1f17-8ec4-49d8-9184-2adaef836a1c req-2c856f83-0102-4051-9b71-71646068407a service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Received event network-vif-plugged-0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:26:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ebad1f17-8ec4-49d8-9184-2adaef836a1c req-2c856f83-0102-4051-9b71-71646068407a service nova] Acquiring lock "01b66315-e6be-4f03-958c-514222a7848e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ebad1f17-8ec4-49d8-9184-2adaef836a1c req-2c856f83-0102-4051-9b71-71646068407a service nova] Lock "01b66315-e6be-4f03-958c-514222a7848e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ebad1f17-8ec4-49d8-9184-2adaef836a1c req-2c856f83-0102-4051-9b71-71646068407a service nova] Lock "01b66315-e6be-4f03-958c-514222a7848e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-ebad1f17-8ec4-49d8-9184-2adaef836a1c req-2c856f83-0102-4051-9b71-71646068407a service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] No waiting events found dispatching network-vif-plugged-0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:26:48 user nova-compute[75342]: WARNING nova.compute.manager [req-ebad1f17-8ec4-49d8-9184-2adaef836a1c req-2c856f83-0102-4051-9b71-71646068407a service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Received unexpected event network-vif-plugged-0abf9549-d158-43b5-a957-c948cad17d00 for instance with vm_state deleted and task_state None.
Nov 16 18:26:48 user nova-compute[75342]: DEBUG nova.compute.manager [req-ebad1f17-8ec4-49d8-9184-2adaef836a1c req-2c856f83-0102-4051-9b71-71646068407a service nova] [instance: 01b66315-e6be-4f03-958c-514222a7848e] Received event network-vif-deleted-0abf9549-d158-43b5-a957-c948cad17d00 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:50 user nova-compute[75342]: INFO nova.compute.manager [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Terminating instance
Nov 16 18:26:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-ab62c9a4-1b9e-4465-9484-9a256f8c8a62 req-fd4c5229-b0d3-410b-9488-544218508fed service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-unplugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab62c9a4-1b9e-4465-9484-9a256f8c8a62 req-fd4c5229-b0d3-410b-9488-544218508fed service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab62c9a4-1b9e-4465-9484-9a256f8c8a62 req-fd4c5229-b0d3-410b-9488-544218508fed service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ab62c9a4-1b9e-4465-9484-9a256f8c8a62 req-fd4c5229-b0d3-410b-9488-544218508fed service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-ab62c9a4-1b9e-4465-9484-9a256f8c8a62 req-fd4c5229-b0d3-410b-9488-544218508fed service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-unplugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:26:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-ab62c9a4-1b9e-4465-9484-9a256f8c8a62 req-fd4c5229-b0d3-410b-9488-544218508fed service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-unplugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:26:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Instance destroyed successfully.
Nov 16 18:26:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lazy-loading 'resources' on Instance uuid 5edd2a74-89b9-4163-b452-d491be30059b {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-314776098',display_name='tempest-ServerStableDeviceRescueTest-server-314776098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-314776098',id=41,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7slAhf1hcJjJc66r2jbRftcH0SKdrSI9SpP1eFgrtS94QNgsdg+iL6y93giftSWmkKIikiQ6vcEwKshKM/mm1C/N/UhH6LgQdD1fQLE7/00l44zE3dmSxSyV3Y4Zgtmg==',key_name='tempest-keypair-609421127',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='385c90950e3c4c7fbdcd36d6d9062685',ramdisk_id='',reservation_id='r-a7m9xowp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1240631636',owner_user_name='tempest-ServerStableDeviceRescueTest-1240631636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:25:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36644656ce1f4f2e8a440d625a7285b3',uuid=5edd2a74-89b9-4163-b452-d491be30059b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Converting VIF {"id": "e421c3fa-c93c-486e-9658-a24ae8089927", "address": "fa:16:3e:4e:b2:a7", "network": {"id": "aad7e3f8-f970-4c25-b0f1-df64acead2f1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1536697038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "385c90950e3c4c7fbdcd36d6d9062685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape421c3fa-c9", "ovs_interfaceid": "e421c3fa-c93c-486e-9658-a24ae8089927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b2:a7,bridge_name='br-int',has_traffic_filtering=True,id=e421c3fa-c93c-486e-9658-a24ae8089927,network=Network(aad7e3f8-f970-4c25-b0f1-df64acead2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape421c3fa-c9') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_vif [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b2:a7,bridge_name='br-int',has_traffic_filtering=True,id=e421c3fa-c93c-486e-9658-a24ae8089927,network=Network(aad7e3f8-f970-4c25-b0f1-df64acead2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape421c3fa-c9') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape421c3fa-c9, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=640d3425-fecd-4ed5-b311-2ba4340ad6ca) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:51 user nova-compute[75342]: INFO os_vif [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b2:a7,bridge_name='br-int',has_traffic_filtering=True,id=e421c3fa-c93c-486e-9658-a24ae8089927,network=Network(aad7e3f8-f970-4c25-b0f1-df64acead2f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape421c3fa-c9')
Nov 16 18:26:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Deleting instance files /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b_del
Nov 16 18:26:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Deletion of /opt/stack/data/nova/instances/5edd2a74-89b9-4163-b452-d491be30059b_del complete
Nov 16 18:26:51 user nova-compute[75342]: INFO nova.compute.manager [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:26:51 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d is timed out.
Nov 16 18:26:51 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully detached device vdb from instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d from the live domain config.
Nov 16 18:26:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaXRFyPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:26:51 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2537c606-56f4-44f9-bcc4-646b2d364bed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:26:51 user nova-compute[75342]: No targets found.
Nov 16 18:26:51 user nova-compute[75342]: iSNS:
Nov 16 18:26:51 user nova-compute[75342]: No targets found.
Nov 16 18:26:51 user nova-compute[75342]: STATIC:
Nov 16 18:26:51 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb
Nov 16 18:26:51 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:26:51 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:26:51 user nova-compute[75342]: FIRMWARE:
Nov 16 18:26:51 user nova-compute[75342]: No targets found.
Nov 16 18:26:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:26:51 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:26:51 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94ebc0d-b118-41f3-ba8d-f17a917cb09c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5318b0-a043-4f94-847b-d8ff2f05d3f9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb (non-flash)
Nov 16 18:26:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a468d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb'): ({'sdc'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Removing single pathed devices sdc {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[415c97d8-d043-4264-801c-5c8b5f45b502]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0465ec94-35b4-47d8-ba6c-33c1b31f455a]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Flushing IO for device /dev/sdc {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[87872a49-2452-4b32-bf3d-42942d6faf84]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efe64ef-776f-410b-a3ab-31de346f1fb7]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caecd77-8cc3-40e7-9418-49340635b742]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:26:51 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Took 0.79 seconds to deallocate network for instance.
Nov 16 18:26:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-4d838699-dad7-491a-b693-2bc31d25a281 req-cb88f275-5297-48a8-80cb-b052ef6ec85a service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-deleted-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae0098a-d049-4b68-8c0c-c4d54e53199b]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb, portal: 172.16.0.220,3260]
Nov 16 18:26:51 user nova-compute[75342]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb, portal: 172.16.0.220,3260] successful.
Nov 16 18:26:51 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bfc2dba-bde1-451d-8a4b-dcfcce9d7fdb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[09553f43-c1c7-4296-9c55-fbd1218e39cb]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] <== disconnect_volume: return (262ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:52 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:26:52 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:26:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:52 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Deleted allocations for instance 5edd2a74-89b9-4163-b452-d491be30059b
Nov 16 18:26:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-6fcf2e5a-040c-43d4-9133-0d4e82c5aba2 tempest-ServerStableDeviceRescueTest-1240631636 tempest-ServerStableDeviceRescueTest-1240631636-project-member] Lock "5edd2a74-89b9-4163-b452-d491be30059b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.011s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:52 user nova-compute[75342]: DEBUG nova.objects.instance [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'flavor' on Instance uuid f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:26:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-15dd2e4c-923b-4863-ba0f-6bbfead1ddee req-50465edf-d6e0-4c18-8c99-0aecbd8edc8f service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:26:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-15dd2e4c-923b-4863-ba0f-6bbfead1ddee req-50465edf-d6e0-4c18-8c99-0aecbd8edc8f service nova] Acquiring lock "5edd2a74-89b9-4163-b452-d491be30059b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-15dd2e4c-923b-4863-ba0f-6bbfead1ddee req-50465edf-d6e0-4c18-8c99-0aecbd8edc8f service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-15dd2e4c-923b-4863-ba0f-6bbfead1ddee req-50465edf-d6e0-4c18-8c99-0aecbd8edc8f service nova] Lock "5edd2a74-89b9-4163-b452-d491be30059b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-15dd2e4c-923b-4863-ba0f-6bbfead1ddee req-50465edf-d6e0-4c18-8c99-0aecbd8edc8f service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] No waiting events found dispatching network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:26:52 user nova-compute[75342]: WARNING nova.compute.manager [req-15dd2e4c-923b-4863-ba0f-6bbfead1ddee req-50465edf-d6e0-4c18-8c99-0aecbd8edc8f service nova] [instance: 5edd2a74-89b9-4163-b452-d491be30059b] Received unexpected event network-vif-plugged-e421c3fa-c93c-486e-9658-a24ae8089927 for instance with vm_state deleted and task_state None.
Nov 16 18:26:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-5e8d056c-4e55-48d8-bbea-799e00b1bc23 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.649s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:53 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:53 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:53 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:53 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:26:54 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:26:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:26:58 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:26:58 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:26:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8550MB free_disk=25.023502349853516GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 7399ebfd-2764-47f1-90fe-d20079dfd171 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:26:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:27:02 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:27:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:27:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:27:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:27:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:27:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:27:02 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:27:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updating instance_info_cache with network_info: [{"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:27:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:27:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:27:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:27:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG nova.objects.instance [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:04 user nova-compute[75342]: INFO nova.compute.manager [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attaching volume 9800ad6d-8f5c-44c9-a7a9-568726a50870 to /dev/vdb
Nov 16 18:27:04 user nova-compute[75342]: DEBUG os_brick.utils [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac035cd-77bd-412c-a890-c1bb17dccce0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cc0751-702b-46e1-9a28-b0d81f38772e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf9aded-afe4-4091-acd7-576e5936a24a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a362c74c-46bf-4cc9-ba9a-105102688932]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:27:04 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:27:04 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[77aefb5c-0d45-4af6-875c-16a13a37fb55]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG os_brick.utils [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:27:04 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updating existing volume attachment record: 058b271b-dcdb-488d-8ee3-27ee441a12e1 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:27:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:27:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSmyUnMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:27:09 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:27:09 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:27:09 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[647a391d-0066-41b7-931b-07978fa15828]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:27:09 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5411ad54-f31e-4ab5-bcde-2b8bbcf3d297]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870] added
Nov 16 18:27:09 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb072b0a-52d8-41c4-a81e-add93c5470b1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65bba69-8edd-4066-9f96-069b4e6b7912]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSmyUnMV {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSmyUnMV" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c56127-8739-4cd5-a790-f96926ea6272]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wSmyUnMV'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7311ace-af91-407c-aac6-10feb7abe92a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c36cffe-d53d-451f-8361-b3fb4bd0eef6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:27:09 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:27:09 user nova-compute[75342]:  {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:27:09 user nova-compute[75342]: WARNING os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 18:27:09 user nova-compute[75342]: 
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-27ea4ecc-eb0a-4bc1-9859-f140ee2ffcf9 req-995c5abb-5421-4f67-885f-c71a56af66d4 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received event network-changed-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-27ea4ecc-eb0a-4bc1-9859-f140ee2ffcf9 req-995c5abb-5421-4f67-885f-c71a56af66d4 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Refreshing instance network info cache due to event network-changed-2449ec97-62ae-4f59-a0be-5af2ec7bc250. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-27ea4ecc-eb0a-4bc1-9859-f140ee2ffcf9 req-995c5abb-5421-4f67-885f-c71a56af66d4 service nova] Acquiring lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-27ea4ecc-eb0a-4bc1-9859-f140ee2ffcf9 req-995c5abb-5421-4f67-885f-c71a56af66d4 service nova] Acquired lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-27ea4ecc-eb0a-4bc1-9859-f140ee2ffcf9 req-995c5abb-5421-4f67-885f-c71a56af66d4 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Refreshing network info cache for port 2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "7399ebfd-2764-47f1-90fe-d20079dfd171" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c413bd-4813-455a-81f5-e4b2c61fa01c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870, portal: 172.16.0.220,3260]
Nov 16 18:27:09 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870, portal: 172.16.0.220,3260] successful.
Nov 16 18:27:09 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:27:09 user nova-compute[75342]: INFO nova.compute.manager [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Terminating instance
Nov 16 18:27:09 user nova-compute[75342]: DEBUG nova.compute.manager [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[243138d9-ff78-4e04-8443-1e064170a9c8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[496e8488-cbf6-41b3-9aff-a490bbdd8f70]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 (non-flash)
Nov 16 18:27:09 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 (non-flash)
Nov 16 18:27:09 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b163b607-639e-4dcc-9b2d-f6d1d8ede9cf]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSmyUnMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG nova.network.neutron [req-27ea4ecc-eb0a-4bc1-9859-f140ee2ffcf9 req-995c5abb-5421-4f67-885f-c71a56af66d4 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Updated VIF entry in instance network info cache for port 2449ec97-62ae-4f59-a0be-5af2ec7bc250. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG nova.network.neutron [req-27ea4ecc-eb0a-4bc1-9859-f140ee2ffcf9 req-995c5abb-5421-4f67-885f-c71a56af66d4 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Updating instance_info_cache with network_info: [{"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-27ea4ecc-eb0a-4bc1-9859-f140ee2ffcf9 req-995c5abb-5421-4f67-885f-c71a56af66d4 service nova] Releasing lock "refresh_cache-7399ebfd-2764-47f1-90fe-d20079dfd171" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:27:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Instance destroyed successfully.
Nov 16 18:27:10 user nova-compute[75342]: DEBUG nova.objects.instance [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lazy-loading 'resources' on Instance uuid 7399ebfd-2764-47f1-90fe-d20079dfd171 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-55282173',display_name='tempest-TestStampPattern-server-55282173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-55282173',id=48,image_ref='134ad093-3e22-485d-b11d-a959484ff0ae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWRDrITjp8lV/bdrgBAnPtDPz8fSKsjO1nF68velNrRvChHnjZw1cZB/Ss4eCH0mBq/oxSBLNXAorbiApAZVZPOeZgKRGyEshGk6TU4B3fctyTamQK6QGS51fl7NMXCbw==',key_name='tempest-TestStampPattern-842187603',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:24:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30aa87387053460b9575cd8fb070af29',ramdisk_id='',reservation_id='r-nqaxoc07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9fb5b39f-affa-4dc0-b38a-3e3bfad36495',image_min_disk='1',image_min_ram='0',image_owner_id='30aa87387053460b9575cd8fb070af29',image_owner_project_name='tempest-TestStampPattern-1612033621',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1612033621-project-member',image_user_id='8824c1e02e5e41a7beb3a08a5e5b7124',owner_project_name='tempest-TestStampPattern-1612033621',owner_user_name='tempest-TestStampPattern-1612033621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:24:25Z,user_data=None,user_id='8824c1e02e5e41a7beb3a08a5e5b7124',uuid=7399ebfd-2764-47f1-90fe-d20079dfd171,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converting VIF {"id": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "address": "fa:16:3e:97:03:8c", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2449ec97-62", "ovs_interfaceid": "2449ec97-62ae-4f59-a0be-5af2ec7bc250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=2449ec97-62ae-4f59-a0be-5af2ec7bc250,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2449ec97-62') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG os_vif [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=2449ec97-62ae-4f59-a0be-5af2ec7bc250,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2449ec97-62') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2449ec97-62, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b5b11b1-b072-4665-a272-41e89b5e0290) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:27:10 user nova-compute[75342]: INFO os_vif [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:03:8c,bridge_name='br-int',has_traffic_filtering=True,id=2449ec97-62ae-4f59-a0be-5af2ec7bc250,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2449ec97-62')
Nov 16 18:27:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Deleting instance files /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171_del
Nov 16 18:27:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Deletion of /opt/stack/data/nova/instances/7399ebfd-2764-47f1-90fe-d20079dfd171_del complete
Nov 16 18:27:10 user nova-compute[75342]: INFO nova.compute.manager [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 18:27:10 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26661343634613964', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661343634613964', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG nova.objects.instance [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:27:10 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:27:10 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:27:10 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:27:10 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:27:10 user nova-compute[75342]:   <serial>9800ad6d-8f5c-44c9-a7a9-568726a50870</serial>
Nov 16 18:27:10 user nova-compute[75342]: </disk>
Nov 16 18:27:10 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:27:11 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Took 0.48 seconds to deallocate network for instance.
Nov 16 18:27:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-71d7aa27-c87f-42e0-b18c-75c901f5b310 req-9bee4247-2f23-4149-8ef0-bb2dbb4f8107 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received event network-vif-deleted-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] No VIF found with MAC fa:16:3e:a1:d6:05, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:11 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Deleted allocations for instance 7399ebfd-2764-47f1-90fe-d20079dfd171
Nov 16 18:27:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a9c64571-3460-4c62-bef2-c489ce4e00dc tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.830s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-66b3b543-43d9-4a32-b2f3-4ccb8de8bb03 tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.686s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received event network-vif-unplugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] Acquiring lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] No waiting events found dispatching network-vif-unplugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:27:11 user nova-compute[75342]: WARNING nova.compute.manager [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received unexpected event network-vif-unplugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 for instance with vm_state deleted and task_state None.
Nov 16 18:27:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received event network-vif-plugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] Acquiring lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] Lock "7399ebfd-2764-47f1-90fe-d20079dfd171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] No waiting events found dispatching network-vif-plugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:27:11 user nova-compute[75342]: WARNING nova.compute.manager [req-d6762984-26a9-4c11-bfec-fb35fd40e46c req-8ad21219-82bb-4530-9762-60cb0cc71097 service nova] [instance: 7399ebfd-2764-47f1-90fe-d20079dfd171] Received unexpected event network-vif-plugged-2449ec97-62ae-4f59-a0be-5af2ec7bc250 for instance with vm_state deleted and task_state None.
Nov 16 18:27:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:13 user nova-compute[75342]: INFO nova.compute.manager [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Detaching volume 9800ad6d-8f5c-44c9-a7a9-568726a50870
Nov 16 18:27:13 user nova-compute[75342]: INFO nova.virt.block_device [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Attempting to driver detach volume 9800ad6d-8f5c-44c9-a7a9-568726a50870 from mountpoint /dev/vdb
Nov 16 18:27:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Attempting to detach device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:27:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:27:13 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:27:13 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:27:13 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:27:13 user nova-compute[75342]:   <serial>9800ad6d-8f5c-44c9-a7a9-568726a50870</serial>
Nov 16 18:27:13 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:27:13 user nova-compute[75342]: </disk>
Nov 16 18:27:13 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:27:13 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Successfully detached device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the persistent domain config.
Nov 16 18:27:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:27:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:27:13 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:27:13 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:27:13 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:27:13 user nova-compute[75342]:   <serial>9800ad6d-8f5c-44c9-a7a9-568726a50870</serial>
Nov 16 18:27:13 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:27:13 user nova-compute[75342]: </disk>
Nov 16 18:27:13 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:27:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:27:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:21 user nova-compute[75342]: INFO nova.compute.manager [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Terminating instance
Nov 16 18:27:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-7b3d6c9a-2f08-4866-8243-4f085ad4f47a req-b667d695-755c-4a4c-8246-43980a5ba1fa service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Received event network-vif-unplugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7b3d6c9a-2f08-4866-8243-4f085ad4f47a req-b667d695-755c-4a4c-8246-43980a5ba1fa service nova] Acquiring lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7b3d6c9a-2f08-4866-8243-4f085ad4f47a req-b667d695-755c-4a4c-8246-43980a5ba1fa service nova] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-7b3d6c9a-2f08-4866-8243-4f085ad4f47a req-b667d695-755c-4a4c-8246-43980a5ba1fa service nova] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-7b3d6c9a-2f08-4866-8243-4f085ad4f47a req-b667d695-755c-4a4c-8246-43980a5ba1fa service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] No waiting events found dispatching network-vif-unplugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:27:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-7b3d6c9a-2f08-4866-8243-4f085ad4f47a req-b667d695-755c-4a4c-8246-43980a5ba1fa service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Received event network-vif-unplugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:27:22 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Instance destroyed successfully.
Nov 16 18:27:22 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'resources' on Instance uuid f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1894375165',display_name='tempest-AttachVolumeNegativeTest-server-1894375165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1894375165',id=44,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWJ4+3VoXzPgUlhMA2lm082mH8FIrl1rngApNoOfDfcWBzhP5xst8CV0MB/oXa3oydB+GsbfwwGR0grDVRyxE7TaKWR42iUc9rjjFZASQdRUsi5YyiGYe/FZqKz+2OoOw==',key_name='tempest-keypair-1682407278',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:21:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-e0dq14um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:21:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "address": "fa:16:3e:07:34:2a", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ba5522-4a", "ovs_interfaceid": "c3ba5522-4a54-4d69-838c-1ee676262ef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=c3ba5522-4a54-4d69-838c-1ee676262ef1,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ba5522-4a') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG os_vif [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=c3ba5522-4a54-4d69-838c-1ee676262ef1,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ba5522-4a') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3ba5522-4a, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38893b9d-c7d1-4978-855a-1942bcc00f04) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:27:22 user nova-compute[75342]: INFO os_vif [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=c3ba5522-4a54-4d69-838c-1ee676262ef1,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ba5522-4a')
Nov 16 18:27:22 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Deleting instance files /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d_del
Nov 16 18:27:22 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Deletion of /opt/stack/data/nova/instances/f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d_del complete
Nov 16 18:27:22 user nova-compute[75342]: INFO nova.compute.manager [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 16 18:27:22 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:27:22 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:27:23 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:27:23 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Took 1.23 seconds to deallocate network for instance.
Nov 16 18:27:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:23 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:27:23 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:27:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:23 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Deleted allocations for instance f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d
Nov 16 18:27:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-76d7c25a-d202-4325-858f-3cace6a8b4c2 req-87f02358-23d5-4503-a49a-fff703877b5b service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Received event network-vif-plugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:27:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-76d7c25a-d202-4325-858f-3cace6a8b4c2 req-87f02358-23d5-4503-a49a-fff703877b5b service nova] Acquiring lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-76d7c25a-d202-4325-858f-3cace6a8b4c2 req-87f02358-23d5-4503-a49a-fff703877b5b service nova] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-76d7c25a-d202-4325-858f-3cace6a8b4c2 req-87f02358-23d5-4503-a49a-fff703877b5b service nova] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-76d7c25a-d202-4325-858f-3cace6a8b4c2 req-87f02358-23d5-4503-a49a-fff703877b5b service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] No waiting events found dispatching network-vif-plugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:27:23 user nova-compute[75342]: WARNING nova.compute.manager [req-76d7c25a-d202-4325-858f-3cace6a8b4c2 req-87f02358-23d5-4503-a49a-fff703877b5b service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Received unexpected event network-vif-plugged-c3ba5522-4a54-4d69-838c-1ee676262ef1 for instance with vm_state deleted and task_state None.
Nov 16 18:27:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-76d7c25a-d202-4325-858f-3cace6a8b4c2 req-87f02358-23d5-4503-a49a-fff703877b5b service nova] [instance: f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d] Received event network-vif-deleted-c3ba5522-4a54-4d69-838c-1ee676262ef1 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:27:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3e7774d8-4d81-4664-8e51-3bfc53e4d101 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "f216d7ce-7a77-4c2e-bed7-3bc2ac0ff24d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.390s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:27:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:27:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:27:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:27:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:34 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 is timed out.
Nov 16 18:27:34 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Successfully detached device vdb from instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 from the live domain config.
Nov 16 18:27:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSmyUnMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:27:34 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d96c2-cb78-4b8c-b88c-9c2c05fc017d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:27:34 user nova-compute[75342]: No targets found.
Nov 16 18:27:34 user nova-compute[75342]: iSNS:
Nov 16 18:27:34 user nova-compute[75342]: No targets found.
Nov 16 18:27:34 user nova-compute[75342]: STATIC:
Nov 16 18:27:34 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870
Nov 16 18:27:34 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:27:34 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:27:34 user nova-compute[75342]: FIRMWARE:
Nov 16 18:27:34 user nova-compute[75342]: No targets found.
Nov 16 18:27:34 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:27:34 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:27:34 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71018d5-7f28-428d-9d53-2bb4d0833aea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[38409e8e-85ce-4fba-ac7f-063c1830255a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 (non-flash)
Nov 16 18:27:34 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 (non-flash)
Nov 16 18:27:34 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a464a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[238599cb-05a6-4182-97a8-fc35c0510917]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d2b1b3-85e0-4c05-9057-2f8a754a9345]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d92abe-cc0e-49c0-8683-f86c3ea0a53b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e752aa-21b8-426d-b0b4-1e47a372e4df]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e566af97-4b2a-43c4-85f0-0ca86cc2e35c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f848842d-a9ef-4f7a-9ff7-5a262041e52b]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870, portal: 172.16.0.220,3260]
Nov 16 18:27:34 user nova-compute[75342]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870, portal: 172.16.0.220,3260] successful.
Nov 16 18:27:34 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9800ad6d-8f5c-44c9-a7a9-568726a50870 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[db499087-d3f3-4e2a-b45c-00aa3ab99c94]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] <== disconnect_volume: return (320ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:27:34 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:27:35 user nova-compute[75342]: DEBUG nova.objects.instance [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'flavor' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:27:35 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-9c0506bd-8d23-42e6-9168-118adf61ee95 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.653s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:46 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:51 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:27:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:54 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:27:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:27:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:27:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:27:55 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:57 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:27:57 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:27:57 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8721MB free_disk=25.04117202758789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:27:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:27:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:27:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:01 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:02 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:28:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:28:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:28:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:28:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:28:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updating instance_info_cache with network_info: [{"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:28:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-952e341a-db9a-45e6-b3a3-6e97ab8ae524" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:28:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:28:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:28:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:28:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:28:05 user nova-compute[75342]: INFO nova.compute.claims [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Claim successful on node user
Nov 16 18:28:05 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:28:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:28:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG nova.policy [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '752db55aae8e42508a2b5df43e7019f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556d660660644cceb015589ace168ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:28:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Creating image(s)
Nov 16 18:28:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "/opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "/opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "/opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "ebfe353879d51b37a8d73350a7342f173038c0d4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "ebfe353879d51b37a8d73350a7342f173038c0d4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4.part --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4.part --force-share --output=json" returned: 0 in 0.223s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:06 user nova-compute[75342]: DEBUG nova.virt.images [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] 8cab68af-d6b4-49cb-a8f5-631837b3c042 was qcow2, converting to raw {{(pid=75342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 18:28:06 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:28:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4.part /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4.converted {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG nova.network.neutron [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Successfully created port: b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4.part /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4.converted" returned: 0 in 0.392s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4.converted --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-5e9e60f8-aaca-4fd5-b7a5-33155d3e1042 req-d2163eae-405b-4806-9f72-3f434483b734 service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received event network-changed-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-5e9e60f8-aaca-4fd5-b7a5-33155d3e1042 req-d2163eae-405b-4806-9f72-3f434483b734 service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Refreshing instance network info cache due to event network-changed-81d7a65f-87b1-474c-877c-03f5dec5113c. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5e9e60f8-aaca-4fd5-b7a5-33155d3e1042 req-d2163eae-405b-4806-9f72-3f434483b734 service nova] Acquiring lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5e9e60f8-aaca-4fd5-b7a5-33155d3e1042 req-d2163eae-405b-4806-9f72-3f434483b734 service nova] Acquired lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-5e9e60f8-aaca-4fd5-b7a5-33155d3e1042 req-d2163eae-405b-4806-9f72-3f434483b734 service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Refreshing network info cache for port 81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:07 user nova-compute[75342]: INFO nova.compute.manager [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Terminating instance
Nov 16 18:28:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "ebfe353879d51b37a8d73350a7342f173038c0d4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.395s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4 --force-share --output=json" returned: 0 in 0.209s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "ebfe353879d51b37a8d73350a7342f173038c0d4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "ebfe353879d51b37a8d73350a7342f173038c0d4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4 --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4,backing_fmt=raw /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-5e9e60f8-aaca-4fd5-b7a5-33155d3e1042 req-d2163eae-405b-4806-9f72-3f434483b734 service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updated VIF entry in instance network info cache for port 81d7a65f-87b1-474c-877c-03f5dec5113c. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-5e9e60f8-aaca-4fd5-b7a5-33155d3e1042 req-d2163eae-405b-4806-9f72-3f434483b734 service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updating instance_info_cache with network_info: [{"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4,backing_fmt=raw /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk 1073741824" returned: 0 in 0.053s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "ebfe353879d51b37a8d73350a7342f173038c0d4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5e9e60f8-aaca-4fd5-b7a5-33155d3e1042 req-d2163eae-405b-4806-9f72-3f434483b734 service nova] Releasing lock "refresh_cache-9fb5b39f-affa-4dc0-b38a-3e3bfad36495" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4 --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Checking if we can resize image /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:08 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Instance destroyed successfully.
Nov 16 18:28:08 user nova-compute[75342]: DEBUG nova.objects.instance [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lazy-loading 'resources' on Instance uuid 9fb5b39f-affa-4dc0-b38a-3e3bfad36495 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1606760862',display_name='tempest-TestStampPattern-server-1606760862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1606760862',id=43,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWRDrITjp8lV/bdrgBAnPtDPz8fSKsjO1nF68velNrRvChHnjZw1cZB/Ss4eCH0mBq/oxSBLNXAorbiApAZVZPOeZgKRGyEshGk6TU4B3fctyTamQK6QGS51fl7NMXCbw==',key_name='tempest-TestStampPattern-842187603',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30aa87387053460b9575cd8fb070af29',ramdisk_id='',reservation_id='r-53doc6mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1612033621',owner_user_name='tempest-TestStampPattern-1612033621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:24:16Z,user_data=None,user_id='8824c1e02e5e41a7beb3a08a5e5b7124',uuid=9fb5b39f-affa-4dc0-b38a-3e3bfad36495,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converting VIF {"id": "81d7a65f-87b1-474c-877c-03f5dec5113c", "address": "fa:16:3e:2a:89:a9", "network": {"id": "d880ecb4-7538-4b94-95cc-a488fa23481c", "bridge": "br-int", "label": "tempest-TestStampPattern-1052663796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30aa87387053460b9575cd8fb070af29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d7a65f-87", "ovs_interfaceid": "81d7a65f-87b1-474c-877c-03f5dec5113c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=81d7a65f-87b1-474c-877c-03f5dec5113c,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d7a65f-87') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG os_vif [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=81d7a65f-87b1-474c-877c-03f5dec5113c,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d7a65f-87') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81d7a65f-87, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44a74993-e1ae-46a0-803e-b4facdecf6e8) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:08 user nova-compute[75342]: INFO os_vif [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:89:a9,bridge_name='br-int',has_traffic_filtering=True,id=81d7a65f-87b1-474c-877c-03f5dec5113c,network=Network(d880ecb4-7538-4b94-95cc-a488fa23481c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d7a65f-87')
Nov 16 18:28:08 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Deleting instance files /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495_del
Nov 16 18:28:08 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Deletion of /opt/stack/data/nova/instances/9fb5b39f-affa-4dc0-b38a-3e3bfad36495_del complete
Nov 16 18:28:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Cannot resize image /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Ensure instance console log exists: /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:08 user nova-compute[75342]: INFO nova.compute.manager [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 16 18:28:08 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:08 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:28:08 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Took 0.79 seconds to deallocate network for instance.
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-31a7ef42-9f2e-4500-ade5-02172d7988ea req-5e8be9ab-1128-44dc-9c63-b5df7e1ccbb4 service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received event network-vif-deleted-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.network.neutron [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Successfully updated port: b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquired lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.network.neutron [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.network.neutron [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received event network-vif-unplugged-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] Acquiring lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] No waiting events found dispatching network-vif-unplugged-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:28:09 user nova-compute[75342]: WARNING nova.compute.manager [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received unexpected event network-vif-unplugged-81d7a65f-87b1-474c-877c-03f5dec5113c for instance with vm_state deleted and task_state None.
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received event network-vif-plugged-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] Acquiring lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] No waiting events found dispatching network-vif-plugged-81d7a65f-87b1-474c-877c-03f5dec5113c {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:28:09 user nova-compute[75342]: WARNING nova.compute.manager [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] [instance: 9fb5b39f-affa-4dc0-b38a-3e3bfad36495] Received unexpected event network-vif-plugged-81d7a65f-87b1-474c-877c-03f5dec5113c for instance with vm_state deleted and task_state None.
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-changed-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Refreshing instance network info cache due to event network-changed-b32c9b69-9ea2-4252-9875-79c211203004. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] Acquiring lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:09 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Deleted allocations for instance 9fb5b39f-affa-4dc0-b38a-3e3bfad36495
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-2cd323ac-bfee-497a-8028-320d9ca73fee tempest-TestStampPattern-1612033621 tempest-TestStampPattern-1612033621-project-member] Lock "9fb5b39f-affa-4dc0-b38a-3e3bfad36495" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.131s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.network.neutron [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating instance_info_cache with network_info: [{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Releasing lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.compute.manager [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Instance network_info: |[{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] Acquired lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Refreshing network info cache for port b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Start _get_guest_xml network_info=[{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T18:28:02Z,direct_url=<?>,disk_format='qcow2',id=8cab68af-d6b4-49cb-a8f5-631837b3c042,min_disk=0,min_ram=0,name='tempest-scenario-img--453920770',owner='556d660660644cceb015589ace168ca5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T18:28:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': '8cab68af-d6b4-49cb-a8f5-631837b3c042'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:28:09 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:28:09 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T18:28:02Z,direct_url=<?>,disk_format='qcow2',id=8cab68af-d6b4-49cb-a8f5-631837b3c042,min_disk=0,min_ram=0,name='tempest-scenario-img--453920770',owner='556d660660644cceb015589ace168ca5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T18:28:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-189132045',display_name='tempest-TestMinimumBasicScenario-server-189132045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-189132045',id=49,image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdpCPMhK+mW91pY5GzHNS++TI0FODU8JgMhFRCrrFSM7Wq3X4ItO4mnYKoc2+Ddc8qpCv4zK75Tog5oEd3uRpljrseAx9CYal7POT3oMYf94PmIkncBEEvtwpihCw79yA==',key_name='tempest-TestMinimumBasicScenario-1558201364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='556d660660644cceb015589ace168ca5',ramdisk_id='',reservation_id='r-h0uprm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2125212492',owner_user_name='tempest-TestMinimumBasicScenario-2125212492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:28:06Z,user_data=None,user_id='752db55aae8e42508a2b5df43e7019f0',uuid=795db5c6-b8bf-45d8-8eff-ebbb664f6f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converting VIF {"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.objects.instance [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'pci_devices' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:28:09 user nova-compute[75342]:   <uuid>795db5c6-b8bf-45d8-8eff-ebbb664f6f0d</uuid>
Nov 16 18:28:09 user nova-compute[75342]:   <name>instance-00000031</name>
Nov 16 18:28:09 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:28:09 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:28:09 user nova-compute[75342]:   <metadata>
Nov 16 18:28:09 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:28:09 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:28:09 user nova-compute[75342]:       <nova:name>tempest-TestMinimumBasicScenario-server-189132045</nova:name>
Nov 16 18:28:09 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:28:09</nova:creationTime>
Nov 16 18:28:09 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:28:09 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:28:09 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:28:09 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:28:09 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:28:09 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:28:09 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:28:09 user nova-compute[75342]:       <nova:owner>
Nov 16 18:28:09 user nova-compute[75342]:         <nova:user uuid="752db55aae8e42508a2b5df43e7019f0">tempest-TestMinimumBasicScenario-2125212492-project-member</nova:user>
Nov 16 18:28:09 user nova-compute[75342]:         <nova:project uuid="556d660660644cceb015589ace168ca5">tempest-TestMinimumBasicScenario-2125212492</nova:project>
Nov 16 18:28:09 user nova-compute[75342]:       </nova:owner>
Nov 16 18:28:09 user nova-compute[75342]:       <nova:root type="image" uuid="8cab68af-d6b4-49cb-a8f5-631837b3c042"/>
Nov 16 18:28:09 user nova-compute[75342]:       <nova:ports>
Nov 16 18:28:09 user nova-compute[75342]:         <nova:port uuid="b32c9b69-9ea2-4252-9875-79c211203004">
Nov 16 18:28:09 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 18:28:09 user nova-compute[75342]:         </nova:port>
Nov 16 18:28:09 user nova-compute[75342]:       </nova:ports>
Nov 16 18:28:09 user nova-compute[75342]:     </nova:instance>
Nov 16 18:28:09 user nova-compute[75342]:   </metadata>
Nov 16 18:28:09 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:28:09 user nova-compute[75342]:     <system>
Nov 16 18:28:09 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:28:09 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:28:09 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:28:09 user nova-compute[75342]:       <entry name="serial">795db5c6-b8bf-45d8-8eff-ebbb664f6f0d</entry>
Nov 16 18:28:09 user nova-compute[75342]:       <entry name="uuid">795db5c6-b8bf-45d8-8eff-ebbb664f6f0d</entry>
Nov 16 18:28:09 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:28:09 user nova-compute[75342]:     </system>
Nov 16 18:28:09 user nova-compute[75342]:   </sysinfo>
Nov 16 18:28:09 user nova-compute[75342]:   <os>
Nov 16 18:28:09 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:28:09 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:28:09 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:28:09 user nova-compute[75342]:   </os>
Nov 16 18:28:09 user nova-compute[75342]:   <features>
Nov 16 18:28:09 user nova-compute[75342]:     <acpi/>
Nov 16 18:28:09 user nova-compute[75342]:     <apic/>
Nov 16 18:28:09 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:28:09 user nova-compute[75342]:   </features>
Nov 16 18:28:09 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:28:09 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:28:09 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:28:09 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:28:09 user nova-compute[75342]:   </clock>
Nov 16 18:28:09 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:28:09 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:28:09 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:28:09 user nova-compute[75342]:   </cpu>
Nov 16 18:28:09 user nova-compute[75342]:   <devices>
Nov 16 18:28:09 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:28:09 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:28:09 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk"/>
Nov 16 18:28:09 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:28:09 user nova-compute[75342]:     </disk>
Nov 16 18:28:09 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:28:09 user nova-compute[75342]:       <mac address="fa:16:3e:8d:4a:6c"/>
Nov 16 18:28:09 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:28:09 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:28:09 user nova-compute[75342]:       <target dev="tapb32c9b69-9e"/>
Nov 16 18:28:09 user nova-compute[75342]:     </interface>
Nov 16 18:28:09 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:28:09 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/console.log" append="off"/>
Nov 16 18:28:09 user nova-compute[75342]:     </serial>
Nov 16 18:28:09 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:28:09 user nova-compute[75342]:     <video>
Nov 16 18:28:09 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:28:09 user nova-compute[75342]:     </video>
Nov 16 18:28:09 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:28:09 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:28:09 user nova-compute[75342]:     </rng>
Nov 16 18:28:09 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:28:09 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:28:09 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:28:09 user nova-compute[75342]:     </memballoon>
Nov 16 18:28:09 user nova-compute[75342]:   </devices>
Nov 16 18:28:09 user nova-compute[75342]: </domain>
Nov 16 18:28:09 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-189132045',display_name='tempest-TestMinimumBasicScenario-server-189132045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-189132045',id=49,image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdpCPMhK+mW91pY5GzHNS++TI0FODU8JgMhFRCrrFSM7Wq3X4ItO4mnYKoc2+Ddc8qpCv4zK75Tog5oEd3uRpljrseAx9CYal7POT3oMYf94PmIkncBEEvtwpihCw79yA==',key_name='tempest-TestMinimumBasicScenario-1558201364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='556d660660644cceb015589ace168ca5',ramdisk_id='',reservation_id='r-h0uprm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2125212492',owner_user_name='tempest-TestMinimumBasicScenario-2125212492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:28:06Z,user_data=None,user_id='752db55aae8e42508a2b5df43e7019f0',uuid=795db5c6-b8bf-45d8-8eff-ebbb664f6f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converting VIF {"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG os_vif [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2ae0a59-9a48-54a3-aacb-3a19b17d4bcf', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb32c9b69-9e, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb32c9b69-9e, col_values=(('qos', UUID('33ffa9a6-d95c-4bf9-9f72-33d41556e113')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb32c9b69-9e, col_values=(('external_ids', {'iface-id': 'b32c9b69-9ea2-4252-9875-79c211203004', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:4a:6c', 'vm-uuid': '795db5c6-b8bf-45d8-8eff-ebbb664f6f0d'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:09 user nova-compute[75342]: INFO os_vif [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e')
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] No VIF found with MAC fa:16:3e:8d:4a:6c, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updated VIF entry in instance network info cache for port b32c9b69-9ea2-4252-9875-79c211203004. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating instance_info_cache with network_info: [{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:28:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-34fd51a3-0e86-45ed-a53a-454b7c27d319 req-c1cecfab-329d-4cd0-b9f3-6fae702ca6ba service nova] Releasing lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:28:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-bab5c16e-b232-4407-b3a4-605a9c06b857 req-c1244825-5b31-446e-aa63-342eaf84349c service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-bab5c16e-b232-4407-b3a4-605a9c06b857 req-c1244825-5b31-446e-aa63-342eaf84349c service nova] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-bab5c16e-b232-4407-b3a4-605a9c06b857 req-c1244825-5b31-446e-aa63-342eaf84349c service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-bab5c16e-b232-4407-b3a4-605a9c06b857 req-c1244825-5b31-446e-aa63-342eaf84349c service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-bab5c16e-b232-4407-b3a4-605a9c06b857 req-c1244825-5b31-446e-aa63-342eaf84349c service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] No waiting events found dispatching network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:28:11 user nova-compute[75342]: WARNING nova.compute.manager [req-bab5c16e-b232-4407-b3a4-605a9c06b857 req-c1244825-5b31-446e-aa63-342eaf84349c service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received unexpected event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 for instance with vm_state building and task_state spawning.
Nov 16 18:28:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:11 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-25ebcd34-d788-4938-985a-a04df1ee611f req-b534da4e-d9e0-40de-b17b-3fe4ed275158 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-25ebcd34-d788-4938-985a-a04df1ee611f req-b534da4e-d9e0-40de-b17b-3fe4ed275158 service nova] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-25ebcd34-d788-4938-985a-a04df1ee611f req-b534da4e-d9e0-40de-b17b-3fe4ed275158 service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-25ebcd34-d788-4938-985a-a04df1ee611f req-b534da4e-d9e0-40de-b17b-3fe4ed275158 service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-25ebcd34-d788-4938-985a-a04df1ee611f req-b534da4e-d9e0-40de-b17b-3fe4ed275158 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] No waiting events found dispatching network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:28:13 user nova-compute[75342]: WARNING nova.compute.manager [req-25ebcd34-d788-4938-985a-a04df1ee611f req-b534da4e-d9e0-40de-b17b-3fe4ed275158 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received unexpected event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 for instance with vm_state building and task_state spawning.
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.compute.manager [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:28:13 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Instance spawned successfully.
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:13 user nova-compute[75342]: INFO nova.compute.manager [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Took 7.56 seconds to spawn the instance on the hypervisor.
Nov 16 18:28:13 user nova-compute[75342]: DEBUG nova.compute.manager [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:28:13 user nova-compute[75342]: INFO nova.compute.manager [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Took 8.28 seconds to build instance.
Nov 16 18:28:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-45e5e1fa-2371-4831-8dce-70665635c93a tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.408s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:28:15 user nova-compute[75342]: INFO nova.compute.claims [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Claim successful on node user
Nov 16 18:28:15 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:28:15 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:28:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:28:15 user nova-compute[75342]: DEBUG nova.policy [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6df4253086b4db8b675a6e1b2436b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af578b4b43744644b720ab37606f9752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:28:16 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Creating image(s)
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "/opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "/opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.192s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.187s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk 1073741824" returned: 0 in 0.070s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Successfully created port: 841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.203s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Cannot resize image /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Ensure instance console log exists: /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Successfully updated port: 841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquired lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-07077a10-9bff-4853-b30d-1879701edd51 req-be2cbeee-4fe3-426d-ae3e-405c2a0a1f15 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Received event network-changed-841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.compute.manager [req-07077a10-9bff-4853-b30d-1879701edd51 req-be2cbeee-4fe3-426d-ae3e-405c2a0a1f15 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Refreshing instance network info cache due to event network-changed-841c9e78-cf44-4004-94ec-120508987a24. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-07077a10-9bff-4853-b30d-1879701edd51 req-be2cbeee-4fe3-426d-ae3e-405c2a0a1f15 service nova] Acquiring lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.network.neutron [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Updating instance_info_cache with network_info: [{"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Releasing lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Instance network_info: |[{"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-07077a10-9bff-4853-b30d-1879701edd51 req-be2cbeee-4fe3-426d-ae3e-405c2a0a1f15 service nova] Acquired lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.network.neutron [req-07077a10-9bff-4853-b30d-1879701edd51 req-be2cbeee-4fe3-426d-ae3e-405c2a0a1f15 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Refreshing network info cache for port 841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Start _get_guest_xml network_info=[{"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:28:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:28:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2043415552',display_name='tempest-AttachVolumeNegativeTest-server-2043415552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2043415552',id=50,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASCFaF9llmzjmYLWp7c5GOkusw2Ax5S8Si0Z7rZWyPuPU0vFYzX0HUctu/w3nZNfSAyvk4SRqM3O20gQ5F2qEbA7fLgZe2RT6BZ+eTg2BSR+/8o6yokmZD4I8EDFID+Gg==',key_name='tempest-keypair-1246137019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-k4yk55dk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:28:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=a3fc75bd-80db-491e-9881-0278c38f5a1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:06:20,bridge_name='br-int',has_traffic_filtering=True,id=841c9e78-cf44-4004-94ec-120508987a24,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841c9e78-cf') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.objects.instance [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'pci_devices' on Instance uuid a3fc75bd-80db-491e-9881-0278c38f5a1a {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:28:17 user nova-compute[75342]:   <uuid>a3fc75bd-80db-491e-9881-0278c38f5a1a</uuid>
Nov 16 18:28:17 user nova-compute[75342]:   <name>instance-00000032</name>
Nov 16 18:28:17 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:28:17 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:28:17 user nova-compute[75342]:   <metadata>
Nov 16 18:28:17 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:28:17 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:28:17 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2043415552</nova:name>
Nov 16 18:28:17 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:28:17</nova:creationTime>
Nov 16 18:28:17 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:28:17 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:28:17 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:28:17 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:28:17 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:28:17 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:28:17 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:28:17 user nova-compute[75342]:       <nova:owner>
Nov 16 18:28:17 user nova-compute[75342]:         <nova:user uuid="c6df4253086b4db8b675a6e1b2436b87">tempest-AttachVolumeNegativeTest-825910471-project-member</nova:user>
Nov 16 18:28:17 user nova-compute[75342]:         <nova:project uuid="af578b4b43744644b720ab37606f9752">tempest-AttachVolumeNegativeTest-825910471</nova:project>
Nov 16 18:28:17 user nova-compute[75342]:       </nova:owner>
Nov 16 18:28:17 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:28:17 user nova-compute[75342]:       <nova:ports>
Nov 16 18:28:17 user nova-compute[75342]:         <nova:port uuid="841c9e78-cf44-4004-94ec-120508987a24">
Nov 16 18:28:17 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 18:28:17 user nova-compute[75342]:         </nova:port>
Nov 16 18:28:17 user nova-compute[75342]:       </nova:ports>
Nov 16 18:28:17 user nova-compute[75342]:     </nova:instance>
Nov 16 18:28:17 user nova-compute[75342]:   </metadata>
Nov 16 18:28:17 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:28:17 user nova-compute[75342]:     <system>
Nov 16 18:28:17 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:28:17 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:28:17 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:28:17 user nova-compute[75342]:       <entry name="serial">a3fc75bd-80db-491e-9881-0278c38f5a1a</entry>
Nov 16 18:28:17 user nova-compute[75342]:       <entry name="uuid">a3fc75bd-80db-491e-9881-0278c38f5a1a</entry>
Nov 16 18:28:17 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:28:17 user nova-compute[75342]:     </system>
Nov 16 18:28:17 user nova-compute[75342]:   </sysinfo>
Nov 16 18:28:17 user nova-compute[75342]:   <os>
Nov 16 18:28:17 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:28:17 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:28:17 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:28:17 user nova-compute[75342]:   </os>
Nov 16 18:28:17 user nova-compute[75342]:   <features>
Nov 16 18:28:17 user nova-compute[75342]:     <acpi/>
Nov 16 18:28:17 user nova-compute[75342]:     <apic/>
Nov 16 18:28:17 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:28:17 user nova-compute[75342]:   </features>
Nov 16 18:28:17 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:28:17 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:28:17 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:28:17 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:28:17 user nova-compute[75342]:   </clock>
Nov 16 18:28:17 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:28:17 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:28:17 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:28:17 user nova-compute[75342]:   </cpu>
Nov 16 18:28:17 user nova-compute[75342]:   <devices>
Nov 16 18:28:17 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:28:17 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:28:17 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk"/>
Nov 16 18:28:17 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:28:17 user nova-compute[75342]:     </disk>
Nov 16 18:28:17 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:28:17 user nova-compute[75342]:       <mac address="fa:16:3e:0e:06:20"/>
Nov 16 18:28:17 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:28:17 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:28:17 user nova-compute[75342]:       <target dev="tap841c9e78-cf"/>
Nov 16 18:28:17 user nova-compute[75342]:     </interface>
Nov 16 18:28:17 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:28:17 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/console.log" append="off"/>
Nov 16 18:28:17 user nova-compute[75342]:     </serial>
Nov 16 18:28:17 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:28:17 user nova-compute[75342]:     <video>
Nov 16 18:28:17 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:28:17 user nova-compute[75342]:     </video>
Nov 16 18:28:17 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:28:17 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:28:17 user nova-compute[75342]:     </rng>
Nov 16 18:28:17 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:28:17 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:28:17 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:28:17 user nova-compute[75342]:     </memballoon>
Nov 16 18:28:17 user nova-compute[75342]:   </devices>
Nov 16 18:28:17 user nova-compute[75342]: </domain>
Nov 16 18:28:17 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2043415552',display_name='tempest-AttachVolumeNegativeTest-server-2043415552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2043415552',id=50,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASCFaF9llmzjmYLWp7c5GOkusw2Ax5S8Si0Z7rZWyPuPU0vFYzX0HUctu/w3nZNfSAyvk4SRqM3O20gQ5F2qEbA7fLgZe2RT6BZ+eTg2BSR+/8o6yokmZD4I8EDFID+Gg==',key_name='tempest-keypair-1246137019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-k4yk55dk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:28:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=a3fc75bd-80db-491e-9881-0278c38f5a1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:06:20,bridge_name='br-int',has_traffic_filtering=True,id=841c9e78-cf44-4004-94ec-120508987a24,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841c9e78-cf') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG os_vif [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:06:20,bridge_name='br-int',has_traffic_filtering=True,id=841c9e78-cf44-4004-94ec-120508987a24,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841c9e78-cf') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c741aef-0e80-5979-8005-1e266d79fe7b', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap841c9e78-cf, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap841c9e78-cf, col_values=(('qos', UUID('568cb306-dbb6-4923-a168-70f706eac351')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap841c9e78-cf, col_values=(('external_ids', {'iface-id': '841c9e78-cf44-4004-94ec-120508987a24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:06:20', 'vm-uuid': 'a3fc75bd-80db-491e-9881-0278c38f5a1a'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:17 user nova-compute[75342]: INFO os_vif [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:06:20,bridge_name='br-int',has_traffic_filtering=True,id=841c9e78-cf44-4004-94ec-120508987a24,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841c9e78-cf')
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:28:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No VIF found with MAC fa:16:3e:0e:06:20, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:28:18 user nova-compute[75342]: DEBUG nova.network.neutron [req-07077a10-9bff-4853-b30d-1879701edd51 req-be2cbeee-4fe3-426d-ae3e-405c2a0a1f15 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Updated VIF entry in instance network info cache for port 841c9e78-cf44-4004-94ec-120508987a24. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:28:18 user nova-compute[75342]: DEBUG nova.network.neutron [req-07077a10-9bff-4853-b30d-1879701edd51 req-be2cbeee-4fe3-426d-ae3e-405c2a0a1f15 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Updating instance_info_cache with network_info: [{"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:28:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-07077a10-9bff-4853-b30d-1879701edd51 req-be2cbeee-4fe3-426d-ae3e-405c2a0a1f15 service nova] Releasing lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:28:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-b1dbb620-ed1b-4b62-9ec5-2a0208a39e74 req-c037239d-a596-41af-926d-1afac30dc2cf service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Received event network-vif-plugged-841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b1dbb620-ed1b-4b62-9ec5-2a0208a39e74 req-c037239d-a596-41af-926d-1afac30dc2cf service nova] Acquiring lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b1dbb620-ed1b-4b62-9ec5-2a0208a39e74 req-c037239d-a596-41af-926d-1afac30dc2cf service nova] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b1dbb620-ed1b-4b62-9ec5-2a0208a39e74 req-c037239d-a596-41af-926d-1afac30dc2cf service nova] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:19 user nova-compute[75342]: DEBUG nova.compute.manager [req-b1dbb620-ed1b-4b62-9ec5-2a0208a39e74 req-c037239d-a596-41af-926d-1afac30dc2cf service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] No waiting events found dispatching network-vif-plugged-841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:28:19 user nova-compute[75342]: WARNING nova.compute.manager [req-b1dbb620-ed1b-4b62-9ec5-2a0208a39e74 req-c037239d-a596-41af-926d-1afac30dc2cf service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Received unexpected event network-vif-plugged-841c9e78-cf44-4004-94ec-120508987a24 for instance with vm_state building and task_state spawning.
Nov 16 18:28:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:28:21 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Instance spawned successfully.
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-5e1e9ff8-51d9-4030-9fe1-34ab37e5ec2a req-92d35131-eaa5-4e65-9c6a-0c980f98ac8c service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Received event network-vif-plugged-841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5e1e9ff8-51d9-4030-9fe1-34ab37e5ec2a req-92d35131-eaa5-4e65-9c6a-0c980f98ac8c service nova] Acquiring lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5e1e9ff8-51d9-4030-9fe1-34ab37e5ec2a req-92d35131-eaa5-4e65-9c6a-0c980f98ac8c service nova] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5e1e9ff8-51d9-4030-9fe1-34ab37e5ec2a req-92d35131-eaa5-4e65-9c6a-0c980f98ac8c service nova] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.compute.manager [req-5e1e9ff8-51d9-4030-9fe1-34ab37e5ec2a req-92d35131-eaa5-4e65-9c6a-0c980f98ac8c service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] No waiting events found dispatching network-vif-plugged-841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:28:21 user nova-compute[75342]: WARNING nova.compute.manager [req-5e1e9ff8-51d9-4030-9fe1-34ab37e5ec2a req-92d35131-eaa5-4e65-9c6a-0c980f98ac8c service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Received unexpected event network-vif-plugged-841c9e78-cf44-4004-94ec-120508987a24 for instance with vm_state building and task_state spawning.
Nov 16 18:28:21 user nova-compute[75342]: INFO nova.compute.manager [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 16 18:28:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:28:21 user nova-compute[75342]: INFO nova.compute.manager [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Took 6.31 seconds to build instance.
Nov 16 18:28:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0eab9eac-822c-4684-b277-cc76524348d4 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.428s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:22 user nova-compute[75342]: INFO nova.compute.manager [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Terminating instance
Nov 16 18:28:22 user nova-compute[75342]: DEBUG nova.compute.manager [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-fe66aa69-2ee5-4f05-8d4f-407c8bf53369 req-01618bf9-756e-4b1f-87b9-d282bcadcd85 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Received event network-vif-unplugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fe66aa69-2ee5-4f05-8d4f-407c8bf53369 req-01618bf9-756e-4b1f-87b9-d282bcadcd85 service nova] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fe66aa69-2ee5-4f05-8d4f-407c8bf53369 req-01618bf9-756e-4b1f-87b9-d282bcadcd85 service nova] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fe66aa69-2ee5-4f05-8d4f-407c8bf53369 req-01618bf9-756e-4b1f-87b9-d282bcadcd85 service nova] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-fe66aa69-2ee5-4f05-8d4f-407c8bf53369 req-01618bf9-756e-4b1f-87b9-d282bcadcd85 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] No waiting events found dispatching network-vif-unplugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG nova.compute.manager [req-fe66aa69-2ee5-4f05-8d4f-407c8bf53369 req-01618bf9-756e-4b1f-87b9-d282bcadcd85 service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Received event network-vif-unplugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:22 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Instance destroyed successfully.
Nov 16 18:28:22 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lazy-loading 'resources' on Instance uuid 952e341a-db9a-45e6-b3a3-6e97ab8ae524 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-408569235',display_name='tempest-SnapshotDataIntegrityTests-server-408569235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-408569235',id=45,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOcM9oUP53yA60pnkVXuYbvv6k+GSc14Hf7oIZBXy+VoDNHQTlBapUQBoYPADfKQfYXuI6Fnpf++TWYJ2gPoQ0P0H8Q6qMgtRopEUDlcbwY6h5HZf5rKR/g9GTRaEvlrQ==',key_name='tempest-keypair-1706832352',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:22:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a214817c58484919adc5dd06fc588977',ramdisk_id='',reservation_id='r-a0j5d93z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-904336717',owner_user_name='tempest-SnapshotDataIntegrityTests-904336717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:22:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ccae5b59579145658e1e5170763158cb',uuid=952e341a-db9a-45e6-b3a3-6e97ab8ae524,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Converting VIF {"id": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "address": "fa:16:3e:a1:d6:05", "network": {"id": "2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2030496806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a214817c58484919adc5dd06fc588977", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f2f4b77-ea", "ovs_interfaceid": "9f2f4b77-ea5f-44cd-a9e6-a48449c85641", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:d6:05,bridge_name='br-int',has_traffic_filtering=True,id=9f2f4b77-ea5f-44cd-a9e6-a48449c85641,network=Network(2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f2f4b77-ea') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG os_vif [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:d6:05,bridge_name='br-int',has_traffic_filtering=True,id=9f2f4b77-ea5f-44cd-a9e6-a48449c85641,network=Network(2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f2f4b77-ea') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f2f4b77-ea, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e39945f-fc12-41cb-b430-7ca8864249c7) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:28:23 user nova-compute[75342]: INFO os_vif [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:d6:05,bridge_name='br-int',has_traffic_filtering=True,id=9f2f4b77-ea5f-44cd-a9e6-a48449c85641,network=Network(2da0ad78-a10d-4189-8bf3-0a3f5cb54ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f2f4b77-ea')
Nov 16 18:28:23 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Deleting instance files /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524_del
Nov 16 18:28:23 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Deletion of /opt/stack/data/nova/instances/952e341a-db9a-45e6-b3a3-6e97ab8ae524_del complete
Nov 16 18:28:23 user nova-compute[75342]: INFO nova.compute.manager [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 18:28:23 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:28:23 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:28:23 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:28:23 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:28:23 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Took 0.77 seconds to deallocate network for instance.
Nov 16 18:28:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:24 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:28:24 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:28:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:24 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Deleted allocations for instance 952e341a-db9a-45e6-b3a3-6e97ab8ae524
Nov 16 18:28:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b7c580c1-4929-4ec6-8dcb-b9554529f269 tempest-SnapshotDataIntegrityTests-904336717 tempest-SnapshotDataIntegrityTests-904336717-project-member] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.034s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-1c46f9a0-0542-4ef9-9cd7-b6de74c985f8 req-dc4c6e98-e244-4807-b9a6-37a722bda45f service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Received event network-vif-plugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1c46f9a0-0542-4ef9-9cd7-b6de74c985f8 req-dc4c6e98-e244-4807-b9a6-37a722bda45f service nova] Acquiring lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1c46f9a0-0542-4ef9-9cd7-b6de74c985f8 req-dc4c6e98-e244-4807-b9a6-37a722bda45f service nova] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1c46f9a0-0542-4ef9-9cd7-b6de74c985f8 req-dc4c6e98-e244-4807-b9a6-37a722bda45f service nova] Lock "952e341a-db9a-45e6-b3a3-6e97ab8ae524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-1c46f9a0-0542-4ef9-9cd7-b6de74c985f8 req-dc4c6e98-e244-4807-b9a6-37a722bda45f service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] No waiting events found dispatching network-vif-plugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:28:24 user nova-compute[75342]: WARNING nova.compute.manager [req-1c46f9a0-0542-4ef9-9cd7-b6de74c985f8 req-dc4c6e98-e244-4807-b9a6-37a722bda45f service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Received unexpected event network-vif-plugged-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 for instance with vm_state deleted and task_state None.
Nov 16 18:28:24 user nova-compute[75342]: DEBUG nova.compute.manager [req-1c46f9a0-0542-4ef9-9cd7-b6de74c985f8 req-dc4c6e98-e244-4807-b9a6-37a722bda45f service nova] [instance: 952e341a-db9a-45e6-b3a3-6e97ab8ae524] Received event network-vif-deleted-9f2f4b77-ea5f-44cd-a9e6-a48449c85641 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:28:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:53 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:28:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:28:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:28:55 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:28:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:28:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:28:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:28:59 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:28:59 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:28:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8589MB free_disk=25.06463623046875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:28:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:28:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:28:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:28:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance a3fc75bd-80db-491e-9881-0278c38f5a1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:28:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:28:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:28:59 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:28:59 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:28:59 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:28:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:29:02 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:29:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:29:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 18:29:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:29:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:29:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:29:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:29:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:29:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:29:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:29:55 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'flavor' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:29:57 user nova-compute[75342]: INFO nova.compute.manager [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Attaching volume 87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f to /dev/vdb
Nov 16 18:29:57 user nova-compute[75342]: DEBUG os_brick.utils [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae02c1b-0cf6-4b4c-8f39-d6e418024430]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a265c7c3-6d2a-4de1-8404-30f275d720ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8983f9fa-d2f2-4267-b698-dbda94a0ddc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[81122995-625a-4f74-945d-f1c5a2f7532b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:29:57 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:29:57 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4265a049-cb51-4bd9-ae12-0cae461e8621]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG os_brick.utils [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:29:57 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating existing volume attachment record: 30e12b63-2872-4123-a55a-e3ebe30f977f {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:29:58 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:29:58 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:29:58 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:01 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:30:01 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:30:01 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=25.060832977294922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:30:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:30:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:30:01 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:30:01 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance a3fc75bd-80db-491e-9881-0278c38f5a1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:30:01 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:30:01 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:30:01 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:30:01 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:30:01 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:30:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyQpiRWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:30:02 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:30:02 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:30:02 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2abf7e-49fb-4d6c-bc86-71b18c166dfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:30:02 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c19790-26d2-4b46-bf00-b9553f3cff7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f] added
Nov 16 18:30:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f6adbc-5451-4a7d-9d69-e3f86755eb95]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7224630d-ac4b-4c20-adcd-d8f764e77509]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DyQpiRWS {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DyQpiRWS" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc7319a-b9ed-4bb4-b107-d14bda8538f4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DyQpiRWS'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5738c3b9-55de-4f54-9f5a-dfa7a19a4206]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[479fb2cb-26b9-4bed-8dae-9e4b95142702]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:30:02 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:30:02 user nova-compute[75342]:  {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:30:02 user nova-compute[75342]: WARNING os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 18:30:02 user nova-compute[75342]: 
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdd3fc5-e852-4bcd-884d-b615eec66525]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260]
Nov 16 18:30:02 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260] successful.
Nov 16 18:30:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f552ae-657a-436c-b45a-2dbefa3a096e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd154b0-a1bc-4173-9fb8-169fdcfce3c7]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fd798c-998d-45fb-8730-e17100cac952]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:30:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyQpiRWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:30:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:30:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:30:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23435376131396337', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:30:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435376131396337', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:30:03 user nova-compute[75342]: DEBUG nova.objects.instance [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'flavor' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:30:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:30:03 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:30:03 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:30:03 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:30:03 user nova-compute[75342]:   <serial>87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f</serial>
Nov 16 18:30:03 user nova-compute[75342]: </disk>
Nov 16 18:30:03 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:30:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:30:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:30:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] No VIF found with MAC fa:16:3e:8d:4a:6c, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:30:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-8d180fb3-c07e-4105-baac-f72f7a82d1ca tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.904s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:30:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:30:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:30:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:30:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:30:04 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:30:04 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:30:05 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating instance_info_cache with network_info: [{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:30:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:30:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:30:05 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:05 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-35cc00e0-9c64-4503-9fc7-b68a7ea6900e req-0a35ca0b-6e22-4771-8803-470f2f42e31d service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Received event network-changed-841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:30:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-35cc00e0-9c64-4503-9fc7-b68a7ea6900e req-0a35ca0b-6e22-4771-8803-470f2f42e31d service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Refreshing instance network info cache due to event network-changed-841c9e78-cf44-4004-94ec-120508987a24. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:30:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-35cc00e0-9c64-4503-9fc7-b68a7ea6900e req-0a35ca0b-6e22-4771-8803-470f2f42e31d service nova] Acquiring lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:30:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-35cc00e0-9c64-4503-9fc7-b68a7ea6900e req-0a35ca0b-6e22-4771-8803-470f2f42e31d service nova] Acquired lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:30:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-35cc00e0-9c64-4503-9fc7-b68a7ea6900e req-0a35ca0b-6e22-4771-8803-470f2f42e31d service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Refreshing network info cache for port 841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:30:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-35cc00e0-9c64-4503-9fc7-b68a7ea6900e req-0a35ca0b-6e22-4771-8803-470f2f42e31d service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Updated VIF entry in instance network info cache for port 841c9e78-cf44-4004-94ec-120508987a24. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:30:06 user nova-compute[75342]: DEBUG nova.network.neutron [req-35cc00e0-9c64-4503-9fc7-b68a7ea6900e req-0a35ca0b-6e22-4771-8803-470f2f42e31d service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Updating instance_info_cache with network_info: [{"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:30:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-35cc00e0-9c64-4503-9fc7-b68a7ea6900e req-0a35ca0b-6e22-4771-8803-470f2f42e31d service nova] Releasing lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:30:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:30:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:30:07 user nova-compute[75342]: DEBUG nova.objects.instance [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'flavor' on Instance uuid a3fc75bd-80db-491e-9881-0278c38f5a1a {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:30:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:30:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:30:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:30:07 user nova-compute[75342]: INFO nova.compute.manager [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Attaching volume f8cb5ea1-bb66-473e-981c-a37c032bcefb to /dev/vdb
Nov 16 18:30:08 user nova-compute[75342]: DEBUG os_brick.utils [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a223e6ef-85d1-44de-b8a7-2d11a5b270fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2602880-0347-4ce8-917f-d2067d192222]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[24308f3c-cb76-4856-a4d4-0da7b8bd7f6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13435b7-ce9e-4f24-8bc7-e0d47902fdc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:30:08 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:30:08 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2af2d0e-5c04-4659-aaeb-cc566902fc7b]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG os_brick.utils [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Updating existing volume attachment record: f6fc1b0e-d412-4d84-a78f-809810bf7b00 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-81cd4f3e-1ec9-4224-9625-869ed46e4992 req-6d4a5158-40f5-45dd-86ea-ad7451846e44 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-changed-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:30:09 user nova-compute[75342]: DEBUG nova.compute.manager [req-81cd4f3e-1ec9-4224-9625-869ed46e4992 req-6d4a5158-40f5-45dd-86ea-ad7451846e44 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Refreshing instance network info cache due to event network-changed-b32c9b69-9ea2-4252-9875-79c211203004. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:30:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-81cd4f3e-1ec9-4224-9625-869ed46e4992 req-6d4a5158-40f5-45dd-86ea-ad7451846e44 service nova] Acquiring lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:30:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-81cd4f3e-1ec9-4224-9625-869ed46e4992 req-6d4a5158-40f5-45dd-86ea-ad7451846e44 service nova] Acquired lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:30:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-81cd4f3e-1ec9-4224-9625-869ed46e4992 req-6d4a5158-40f5-45dd-86ea-ad7451846e44 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Refreshing network info cache for port b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:30:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-81cd4f3e-1ec9-4224-9625-869ed46e4992 req-6d4a5158-40f5-45dd-86ea-ad7451846e44 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updated VIF entry in instance network info cache for port b32c9b69-9ea2-4252-9875-79c211203004. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:30:09 user nova-compute[75342]: DEBUG nova.network.neutron [req-81cd4f3e-1ec9-4224-9625-869ed46e4992 req-6d4a5158-40f5-45dd-86ea-ad7451846e44 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating instance_info_cache with network_info: [{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:30:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-81cd4f3e-1ec9-4224-9625-869ed46e4992 req-6d4a5158-40f5-45dd-86ea-ad7451846e44 service nova] Releasing lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:30:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-86dd8dae-35b8-409a-8cd1-10a40feff447 req-0f1d64fb-c875-4763-aa73-4d523790aed1 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-changed-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:30:11 user nova-compute[75342]: DEBUG nova.compute.manager [req-86dd8dae-35b8-409a-8cd1-10a40feff447 req-0f1d64fb-c875-4763-aa73-4d523790aed1 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Refreshing instance network info cache due to event network-changed-b32c9b69-9ea2-4252-9875-79c211203004. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:30:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-86dd8dae-35b8-409a-8cd1-10a40feff447 req-0f1d64fb-c875-4763-aa73-4d523790aed1 service nova] Acquiring lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:30:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-86dd8dae-35b8-409a-8cd1-10a40feff447 req-0f1d64fb-c875-4763-aa73-4d523790aed1 service nova] Acquired lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:30:11 user nova-compute[75342]: DEBUG nova.network.neutron [req-86dd8dae-35b8-409a-8cd1-10a40feff447 req-0f1d64fb-c875-4763-aa73-4d523790aed1 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Refreshing network info cache for port b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:30:12 user nova-compute[75342]: DEBUG nova.network.neutron [req-86dd8dae-35b8-409a-8cd1-10a40feff447 req-0f1d64fb-c875-4763-aa73-4d523790aed1 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updated VIF entry in instance network info cache for port b32c9b69-9ea2-4252-9875-79c211203004. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:30:12 user nova-compute[75342]: DEBUG nova.network.neutron [req-86dd8dae-35b8-409a-8cd1-10a40feff447 req-0f1d64fb-c875-4763-aa73-4d523790aed1 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating instance_info_cache with network_info: [{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:30:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-86dd8dae-35b8-409a-8cd1-10a40feff447 req-0f1d64fb-c875-4763-aa73-4d523790aed1 service nova] Releasing lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ysjxufom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:30:13 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:30:13 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:30:13 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7900dd-8a14-4880-964a-16b91aa39c6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:30:13 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62d05c8-5f9f-4836-87ef-1821fbc33c5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb] added
Nov 16 18:30:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4638f86b-5513-4e30-8af6-9df5a621b70d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5be7c74-785b-42fa-b6d4-408ab3e08566]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ysjxufom {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ysjxufom" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ad9f90-e827-4dde-8928-8e3c7f6d151b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Ysjxufom'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1194b6-9814-4d8d-8aad-1698f623a6be]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f6681b-170f-4fab-aff2-a182419bfbd6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ee8de8-6d20-4441-914f-02111a49bc36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb, portal: 172.16.0.220,3260]
Nov 16 18:30:13 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb, portal: 172.16.0.220,3260] successful.
Nov 16 18:30:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7338001a-fc1d-4ea8-8422-1f039e7260d2]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[049530c4-a9a7-44fc-b199-08d3fb1ca0b2]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:13 user nova-compute[75342]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)
Nov 16 18:30:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:13 user nova-compute[75342]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)
Nov 16 18:30:13 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8153ea89-ceb2-4b2a-a5ba-75887b51376c]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ysjxufom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:30:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:30:14 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26338303535343838', 'path': '/dev/sdc'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:30:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338303535343838', 'path': '/dev/sdc'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:30:14 user nova-compute[75342]: DEBUG nova.objects.instance [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'flavor' on Instance uuid a3fc75bd-80db-491e-9881-0278c38f5a1a {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:30:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:30:14 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:30:14 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:30:14 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:30:14 user nova-compute[75342]:   <serial>f8cb5ea1-bb66-473e-981c-a37c032bcefb</serial>
Nov 16 18:30:14 user nova-compute[75342]: </disk>
Nov 16 18:30:14 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:30:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:30:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:30:14 user nova-compute[75342]: INFO nova.compute.manager [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Rebooting instance
Nov 16 18:30:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:30:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:30:15 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No VIF found with MAC fa:16:3e:0e:06:20, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:30:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:30:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquired lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:30:15 user nova-compute[75342]: DEBUG nova.network.neutron [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:30:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-0d3d1497-42eb-4304-a96d-eca2796b7b4d tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.184s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:30:15 user nova-compute[75342]: DEBUG nova.network.neutron [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating instance_info_cache with network_info: [{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:30:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Releasing lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:30:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:30:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:16 user nova-compute[75342]: INFO nova.compute.manager [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Detaching volume f8cb5ea1-bb66-473e-981c-a37c032bcefb
Nov 16 18:30:16 user nova-compute[75342]: INFO nova.virt.block_device [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Attempting to driver detach volume f8cb5ea1-bb66-473e-981c-a37c032bcefb from mountpoint /dev/vdb
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Attempting to detach device vdb from instance a3fc75bd-80db-491e-9881-0278c38f5a1a from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:30:16 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:30:16 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:30:16 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:30:16 user nova-compute[75342]:   <serial>f8cb5ea1-bb66-473e-981c-a37c032bcefb</serial>
Nov 16 18:30:16 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:30:16 user nova-compute[75342]: </disk>
Nov 16 18:30:16 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:30:16 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully detached device vdb from instance a3fc75bd-80db-491e-9881-0278c38f5a1a from the persistent domain config.
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3fc75bd-80db-491e-9881-0278c38f5a1a from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:30:16 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:30:16 user nova-compute[75342]:   <source dev="/dev/sdc"/>
Nov 16 18:30:16 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:30:16 user nova-compute[75342]:   <serial>f8cb5ea1-bb66-473e-981c-a37c032bcefb</serial>
Nov 16 18:30:16 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:30:16 user nova-compute[75342]: </disk>
Nov 16 18:30:16 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.compute.manager [req-3e7b8153-2756-4eb3-94f5-a3a3ce18ab22 req-8c34ee28-ad0e-4021-82ad-4e62b740cb3d service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-vif-unplugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3e7b8153-2756-4eb3-94f5-a3a3ce18ab22 req-8c34ee28-ad0e-4021-82ad-4e62b740cb3d service nova] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3e7b8153-2756-4eb3-94f5-a3a3ce18ab22 req-8c34ee28-ad0e-4021-82ad-4e62b740cb3d service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-3e7b8153-2756-4eb3-94f5-a3a3ce18ab22 req-8c34ee28-ad0e-4021-82ad-4e62b740cb3d service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.compute.manager [req-3e7b8153-2756-4eb3-94f5-a3a3ce18ab22 req-8c34ee28-ad0e-4021-82ad-4e62b740cb3d service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] No waiting events found dispatching network-vif-unplugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:30:16 user nova-compute[75342]: WARNING nova.compute.manager [req-3e7b8153-2756-4eb3-94f5-a3a3ce18ab22 req-8c34ee28-ad0e-4021-82ad-4e62b740cb3d service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received unexpected event network-vif-unplugged-b32c9b69-9ea2-4252-9875-79c211203004 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3fc75bd-80db-491e-9881-0278c38f5a1a {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:30:16 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Instance destroyed successfully.
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.objects.instance [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'resources' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-189132045',display_name='tempest-TestMinimumBasicScenario-server-189132045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-189132045',id=49,image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdpCPMhK+mW91pY5GzHNS++TI0FODU8JgMhFRCrrFSM7Wq3X4ItO4mnYKoc2+Ddc8qpCv4zK75Tog5oEd3uRpljrseAx9CYal7POT3oMYf94PmIkncBEEvtwpihCw79yA==',key_name='tempest-TestMinimumBasicScenario-1558201364',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='556d660660644cceb015589ace168ca5',ramdisk_id='',reservation_id='r-h0uprm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2125212492',owner_user_name='tempest-TestMinimumBasicScenario-2125212492-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:30:16Z,user_data=None,user_id='752db55aae8e42508a2b5df43e7019f0',uuid=795db5c6-b8bf-45d8-8eff-ebbb664f6f0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converting VIF {"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG os_vif [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb32c9b69-9e, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33ffa9a6-d95c-4bf9-9f72-33d41556e113) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:16 user nova-compute[75342]: INFO os_vif [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e')
Nov 16 18:30:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyQpiRWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:30:16 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:30:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[702028dc-685f-4421-a0a1-a25dcc34799e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:30:16 user nova-compute[75342]: No targets found.
Nov 16 18:30:16 user nova-compute[75342]: iSNS:
Nov 16 18:30:16 user nova-compute[75342]: No targets found.
Nov 16 18:30:16 user nova-compute[75342]: STATIC:
Nov 16 18:30:16 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f
Nov 16 18:30:16 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:30:16 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:30:16 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb
Nov 16 18:30:16 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:30:16 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:30:16 user nova-compute[75342]: FIRMWARE:
Nov 16 18:30:16 user nova-compute[75342]: No targets found.
Nov 16 18:30:16 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:30:16 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:30:16 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:30:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1510ea-fd8d-4860-9f27-1abe3cb2c8f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3f1a13-1579-415c-9bad-92e0d4b93b53]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:17 user nova-compute[75342]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)
Nov 16 18:30:17 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:17 user nova-compute[75342]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)
Nov 16 18:30:17 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6d01b8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bf03dd-6c2f-45f5-addf-ae4687ef0b43]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b8841d-4b5c-4bce-8393-abf945b13031]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4351af2a-f908-4f3f-865f-42996463f94f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bf1e5f-e396-4fa3-bb42-a5432415d3d8]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[213edb25-87ec-414d-a157-aea2bdb6dd4e]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2042e5-b92d-48b9-9e1e-02734282c726]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260]
Nov 16 18:30:17 user nova-compute[75342]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260] successful.
Nov 16 18:30:17 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe002237-e2dc-4373-a1d4-323e2ff5e0f4]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] <== disconnect_volume: return (281ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Start _get_guest_xml network_info=[{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8cab68af-d6b4-49cb-a8f5-631837b3c042,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': '8cab68af-d6b4-49cb-a8f5-631837b3c042'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '30e12b63-2872-4123-a55a-e3ebe30f977f', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyQpiRWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '795db5c6-b8bf-45d8-8eff-ebbb664f6f0d', 'attached_at': '', 'detached_at': '', 'volume_id': '87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f', 'serial': '87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:30:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:30:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8cab68af-d6b4-49cb-a8f5-631837b3c042,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.objects.instance [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'vcpu_model' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.objects.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Object Instance<795db5c6-b8bf-45d8-8eff-ebbb664f6f0d> lazy-loaded attributes: resources,vcpu_model {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyQpiRWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:30:17 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:30:17 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:30:17 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bac73a-9f96-4432-a977-334b66b715a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:30:17 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0973ad28-bd57-4ef3-97d7-bdaf3e26cd78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f] added
Nov 16 18:30:17 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce54999-4ea4-4294-af72-01706b118c58]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ea160b-7072-4ae8-8efe-21d1276dcca7]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DyQpiRWS {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DyQpiRWS" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d2a0a3-ded6-4714-8656-e70075fc5b60]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DyQpiRWS'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d004ab-d588-4459-97b2-de772390aef9]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[47333f73-0a7a-4b7a-9c39-8cf54ed0cd53]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)
Nov 16 18:30:17 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)
Nov 16 18:30:17 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad912827-4016-4275-9eeb-8dd5ce37f3b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260]
Nov 16 18:30:17 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260] successful.
Nov 16 18:30:17 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6b6a1e-952b-4fdd-ba66-a4e70dc2e79a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[719ddbe6-9e54-4516-92f1-c24b1f680de7]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)
Nov 16 18:30:17 user nova-compute[75342]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:17 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)
Nov 16 18:30:17 user nova-compute[75342]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:17 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46c16ba-cae6-4444-95bb-395453a4a6f8]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:17 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG nova.compute.manager [req-6dfe3fcd-4a09-422c-80d5-cc7b3d802a5e req-2381d727-3c90-4655-82c8-024e5ef5914b service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6dfe3fcd-4a09-422c-80d5-cc7b3d802a5e req-2381d727-3c90-4655-82c8-024e5ef5914b service nova] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6dfe3fcd-4a09-422c-80d5-cc7b3d802a5e req-2381d727-3c90-4655-82c8-024e5ef5914b service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-6dfe3fcd-4a09-422c-80d5-cc7b3d802a5e req-2381d727-3c90-4655-82c8-024e5ef5914b service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG nova.compute.manager [req-6dfe3fcd-4a09-422c-80d5-cc7b3d802a5e req-2381d727-3c90-4655-82c8-024e5ef5914b service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] No waiting events found dispatching network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:30:18 user nova-compute[75342]: WARNING nova.compute.manager [req-6dfe3fcd-4a09-422c-80d5-cc7b3d802a5e req-2381d727-3c90-4655-82c8-024e5ef5914b service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received unexpected event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 18:30:18 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyQpiRWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23435376131396337', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435376131396337', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-189132045',display_name='tempest-TestMinimumBasicScenario-server-189132045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-189132045',id=49,image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdpCPMhK+mW91pY5GzHNS++TI0FODU8JgMhFRCrrFSM7Wq3X4ItO4mnYKoc2+Ddc8qpCv4zK75Tog5oEd3uRpljrseAx9CYal7POT3oMYf94PmIkncBEEvtwpihCw79yA==',key_name='tempest-TestMinimumBasicScenario-1558201364',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='556d660660644cceb015589ace168ca5',ramdisk_id='',reservation_id='r-h0uprm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2125212492',owner_user_name='tempest-TestMinimumBasicScenario-2125212492-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:30:16Z,user_data=None,user_id='752db55aae8e42508a2b5df43e7019f0',uuid=795db5c6-b8bf-45d8-8eff-ebbb664f6f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converting VIF {"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG nova.objects.instance [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'pci_devices' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG nova.objects.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Object Instance<795db5c6-b8bf-45d8-8eff-ebbb664f6f0d> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:30:18 user nova-compute[75342]:   <uuid>795db5c6-b8bf-45d8-8eff-ebbb664f6f0d</uuid>
Nov 16 18:30:18 user nova-compute[75342]:   <name>instance-00000031</name>
Nov 16 18:30:18 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:30:18 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:30:18 user nova-compute[75342]:   <metadata>
Nov 16 18:30:18 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:30:18 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:30:18 user nova-compute[75342]:       <nova:name>tempest-TestMinimumBasicScenario-server-189132045</nova:name>
Nov 16 18:30:18 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:30:17</nova:creationTime>
Nov 16 18:30:18 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:30:18 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:30:18 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:30:18 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:30:18 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:30:18 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:30:18 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:30:18 user nova-compute[75342]:       <nova:owner>
Nov 16 18:30:18 user nova-compute[75342]:         <nova:user uuid="752db55aae8e42508a2b5df43e7019f0">tempest-TestMinimumBasicScenario-2125212492-project-member</nova:user>
Nov 16 18:30:18 user nova-compute[75342]:         <nova:project uuid="556d660660644cceb015589ace168ca5">tempest-TestMinimumBasicScenario-2125212492</nova:project>
Nov 16 18:30:18 user nova-compute[75342]:       </nova:owner>
Nov 16 18:30:18 user nova-compute[75342]:       <nova:root type="image" uuid="8cab68af-d6b4-49cb-a8f5-631837b3c042"/>
Nov 16 18:30:18 user nova-compute[75342]:       <nova:ports>
Nov 16 18:30:18 user nova-compute[75342]:         <nova:port uuid="b32c9b69-9ea2-4252-9875-79c211203004">
Nov 16 18:30:18 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 18:30:18 user nova-compute[75342]:         </nova:port>
Nov 16 18:30:18 user nova-compute[75342]:       </nova:ports>
Nov 16 18:30:18 user nova-compute[75342]:     </nova:instance>
Nov 16 18:30:18 user nova-compute[75342]:   </metadata>
Nov 16 18:30:18 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:30:18 user nova-compute[75342]:     <system>
Nov 16 18:30:18 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:30:18 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:30:18 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:30:18 user nova-compute[75342]:       <entry name="serial">795db5c6-b8bf-45d8-8eff-ebbb664f6f0d</entry>
Nov 16 18:30:18 user nova-compute[75342]:       <entry name="uuid">795db5c6-b8bf-45d8-8eff-ebbb664f6f0d</entry>
Nov 16 18:30:18 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:30:18 user nova-compute[75342]:     </system>
Nov 16 18:30:18 user nova-compute[75342]:   </sysinfo>
Nov 16 18:30:18 user nova-compute[75342]:   <os>
Nov 16 18:30:18 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:30:18 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:30:18 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:30:18 user nova-compute[75342]:   </os>
Nov 16 18:30:18 user nova-compute[75342]:   <features>
Nov 16 18:30:18 user nova-compute[75342]:     <acpi/>
Nov 16 18:30:18 user nova-compute[75342]:     <apic/>
Nov 16 18:30:18 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:30:18 user nova-compute[75342]:   </features>
Nov 16 18:30:18 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:30:18 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:30:18 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:30:18 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:30:18 user nova-compute[75342]:   </clock>
Nov 16 18:30:18 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:30:18 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:30:18 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:30:18 user nova-compute[75342]:   </cpu>
Nov 16 18:30:18 user nova-compute[75342]:   <devices>
Nov 16 18:30:18 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:30:18 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:30:18 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk"/>
Nov 16 18:30:18 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:30:18 user nova-compute[75342]:     </disk>
Nov 16 18:30:18 user nova-compute[75342]:     <disk type="block" device="disk">
Nov 16 18:30:18 user nova-compute[75342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:30:18 user nova-compute[75342]:       <source dev="/dev/sdb"/>
Nov 16 18:30:18 user nova-compute[75342]:       <target dev="vdb" bus="virtio"/>
Nov 16 18:30:18 user nova-compute[75342]:       <serial>87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f</serial>
Nov 16 18:30:18 user nova-compute[75342]:     </disk>
Nov 16 18:30:18 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:30:18 user nova-compute[75342]:       <mac address="fa:16:3e:8d:4a:6c"/>
Nov 16 18:30:18 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:30:18 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:30:18 user nova-compute[75342]:       <target dev="tapb32c9b69-9e"/>
Nov 16 18:30:18 user nova-compute[75342]:     </interface>
Nov 16 18:30:18 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:30:18 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/console.log" append="off"/>
Nov 16 18:30:18 user nova-compute[75342]:     </serial>
Nov 16 18:30:18 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:30:18 user nova-compute[75342]:     <video>
Nov 16 18:30:18 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:30:18 user nova-compute[75342]:     </video>
Nov 16 18:30:18 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:30:18 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:30:18 user nova-compute[75342]:     </rng>
Nov 16 18:30:18 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:30:18 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:30:18 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:30:18 user nova-compute[75342]:     </memballoon>
Nov 16 18:30:18 user nova-compute[75342]:   </devices>
Nov 16 18:30:18 user nova-compute[75342]: </domain>
Nov 16 18:30:18 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:18 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG nova.objects.instance [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'trusted_certs' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG nova.objects.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Object Instance<795db5c6-b8bf-45d8-8eff-ebbb664f6f0d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4 --force-share --output=json" returned: 0 in 0.168s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Checking if we can resize image /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Cannot resize image /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG nova.objects.instance [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'migration_context' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG nova.objects.base [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Object Instance<795db5c6-b8bf-45d8-8eff-ebbb664f6f0d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-189132045',display_name='tempest-TestMinimumBasicScenario-server-189132045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-189132045',id=49,image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdpCPMhK+mW91pY5GzHNS++TI0FODU8JgMhFRCrrFSM7Wq3X4ItO4mnYKoc2+Ddc8qpCv4zK75Tog5oEd3uRpljrseAx9CYal7POT3oMYf94PmIkncBEEvtwpihCw79yA==',key_name='tempest-TestMinimumBasicScenario-1558201364',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='556d660660644cceb015589ace168ca5',ramdisk_id='',reservation_id='r-h0uprm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2125212492',owner_user_name='tempest-TestMinimumBasicScenario-2125212492-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:30:16Z,user_data=None,user_id='752db55aae8e42508a2b5df43e7019f0',uuid=795db5c6-b8bf-45d8-8eff-ebbb664f6f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converting VIF {"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG os_vif [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2ae0a59-9a48-54a3-aacb-3a19b17d4bcf', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb32c9b69-9e, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb32c9b69-9e, col_values=(('qos', UUID('c68f67dc-fa49-4cec-bf70-8eff65dc4dcc')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb32c9b69-9e, col_values=(('external_ids', {'iface-id': 'b32c9b69-9ea2-4252-9875-79c211203004', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:4a:6c', 'vm-uuid': '795db5c6-b8bf-45d8-8eff-ebbb664f6f0d'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:30:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:19 user nova-compute[75342]: INFO os_vif [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e')
Nov 16 18:30:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-f7756db1-43e9-48bd-82ea-b86b4a3e8970 req-5cf12153-0a44-4207-be51-566e241d2523 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:30:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f7756db1-43e9-48bd-82ea-b86b4a3e8970 req-5cf12153-0a44-4207-be51-566e241d2523 service nova] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:30:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f7756db1-43e9-48bd-82ea-b86b4a3e8970 req-5cf12153-0a44-4207-be51-566e241d2523 service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:30:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f7756db1-43e9-48bd-82ea-b86b4a3e8970 req-5cf12153-0a44-4207-be51-566e241d2523 service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:30:20 user nova-compute[75342]: DEBUG nova.compute.manager [req-f7756db1-43e9-48bd-82ea-b86b4a3e8970 req-5cf12153-0a44-4207-be51-566e241d2523 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] No waiting events found dispatching network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:30:20 user nova-compute[75342]: WARNING nova.compute.manager [req-f7756db1-43e9-48bd-82ea-b86b4a3e8970 req-5cf12153-0a44-4207-be51-566e241d2523 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received unexpected event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 18:30:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:21 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:22 user nova-compute[75342]: DEBUG nova.compute.manager [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:30:22 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Instance rebooted successfully.
Nov 16 18:30:22 user nova-compute[75342]: DEBUG nova.compute.manager [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:30:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-02f33da3-1431-495c-9d49-92478357a93b tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.005s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:30:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-1a3c4fdb-9e0a-471f-bd48-3de487d786f4 req-5de76254-b757-4fa4-a252-9b767e079d31 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:30:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1a3c4fdb-9e0a-471f-bd48-3de487d786f4 req-5de76254-b757-4fa4-a252-9b767e079d31 service nova] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:30:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1a3c4fdb-9e0a-471f-bd48-3de487d786f4 req-5de76254-b757-4fa4-a252-9b767e079d31 service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:30:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1a3c4fdb-9e0a-471f-bd48-3de487d786f4 req-5de76254-b757-4fa4-a252-9b767e079d31 service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:30:23 user nova-compute[75342]: DEBUG nova.compute.manager [req-1a3c4fdb-9e0a-471f-bd48-3de487d786f4 req-5de76254-b757-4fa4-a252-9b767e079d31 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] No waiting events found dispatching network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:30:23 user nova-compute[75342]: WARNING nova.compute.manager [req-1a3c4fdb-9e0a-471f-bd48-3de487d786f4 req-5de76254-b757-4fa4-a252-9b767e079d31 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received unexpected event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 for instance with vm_state active and task_state None.
Nov 16 18:30:23 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:28 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:30:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:30:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:30:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:30:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:36 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a3fc75bd-80db-491e-9881-0278c38f5a1a is timed out.
Nov 16 18:30:36 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully detached device vdb from instance a3fc75bd-80db-491e-9881-0278c38f5a1a from the live domain config.
Nov 16 18:30:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ysjxufom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:30:36 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29b829a-7898-4ca5-8912-4743244898ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:30:36 user nova-compute[75342]: No targets found.
Nov 16 18:30:36 user nova-compute[75342]: iSNS:
Nov 16 18:30:36 user nova-compute[75342]: No targets found.
Nov 16 18:30:36 user nova-compute[75342]: STATIC:
Nov 16 18:30:36 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f
Nov 16 18:30:36 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:30:36 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:30:36 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb
Nov 16 18:30:36 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:30:36 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:30:36 user nova-compute[75342]: FIRMWARE:
Nov 16 18:30:36 user nova-compute[75342]: No targets found.
Nov 16 18:30:36 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:30:36 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:30:36 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[86222d3f-7c73-41a6-8537-7e16965c8128]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[509bed2b-f97b-430f-bb31-0bbbf77a4473]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)
Nov 16 18:30:36 user nova-compute[75342]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:36 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb (non-flash)
Nov 16 18:30:36 user nova-compute[75342]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:30:36 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a452e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb'): ({'sdc'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Removing single pathed devices sdc {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d068ed92-3f6e-4a68-8f6b-6468143436c0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5da6cc0-9c49-4bec-bdc0-292a70e1273f]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Flushing IO for device /dev/sdc {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a0f13a-c490-4d0a-8ac1-d8e0deede2b8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a03f6f6-10a7-483e-9e3e-4be7a2d5828d]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] SCSI volumes sdc have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[405b8cf0-3f2c-4bca-b7b2-6128838c351c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eaddf0-5c37-4cc5-a55c-dc87c94f70dd]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb, portal: 172.16.0.220,3260]
Nov 16 18:30:36 user nova-compute[75342]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb, portal: 172.16.0.220,3260] successful.
Nov 16 18:30:36 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8cb5ea1-bb66-473e-981c-a37c032bcefb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69ce071-257b-4537-84af-b3171b957dc8]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] <== disconnect_volume: return (311ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:30:36 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:30:37 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'flavor' on Instance uuid a3fc75bd-80db-491e-9881-0278c38f5a1a {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:30:37 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1ef5996c-3a9f-4b50-ba1f-287e84d0dba8 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.640s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:30:38 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:49 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 18:30:49 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] There are 0 instances to clean {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 18:30:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:30:56 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:57 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:57 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:30:59 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:59 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:30:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:30:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:30:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:30:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:30:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:30:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:31:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:31:03 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:31:03 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:31:03 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.050498962402344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance a3fc75bd-80db-491e-9881-0278c38f5a1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing inventories for resource provider fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating ProviderTree inventory for provider fdd6b940-75a0-4315-8416-79157aaeea59 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing aggregate associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, aggregates: None {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 18:31:03 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing trait associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, traits: COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 18:31:04 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:31:04 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:31:04 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:31:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:31:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:31:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 18:31:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:31:06 user nova-compute[75342]: INFO nova.compute.manager [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Terminating instance
Nov 16 18:31:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-fc232802-1cbe-4e4d-a8b8-5ca9a670d69f req-5c2be920-9c89-4c04-af76-fa21f0e16806 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Received event network-vif-unplugged-841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fc232802-1cbe-4e4d-a8b8-5ca9a670d69f req-5c2be920-9c89-4c04-af76-fa21f0e16806 service nova] Acquiring lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fc232802-1cbe-4e4d-a8b8-5ca9a670d69f req-5c2be920-9c89-4c04-af76-fa21f0e16806 service nova] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fc232802-1cbe-4e4d-a8b8-5ca9a670d69f req-5c2be920-9c89-4c04-af76-fa21f0e16806 service nova] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-fc232802-1cbe-4e4d-a8b8-5ca9a670d69f req-5c2be920-9c89-4c04-af76-fa21f0e16806 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] No waiting events found dispatching network-vif-unplugged-841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-fc232802-1cbe-4e4d-a8b8-5ca9a670d69f req-5c2be920-9c89-4c04-af76-fa21f0e16806 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Received event network-vif-unplugged-841c9e78-cf44-4004-94ec-120508987a24 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Updating instance_info_cache with network_info: [{"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-a3fc75bd-80db-491e-9881-0278c38f5a1a" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:31:06 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:31:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Instance destroyed successfully.
Nov 16 18:31:07 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'resources' on Instance uuid a3fc75bd-80db-491e-9881-0278c38f5a1a {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2043415552',display_name='tempest-AttachVolumeNegativeTest-server-2043415552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2043415552',id=50,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASCFaF9llmzjmYLWp7c5GOkusw2Ax5S8Si0Z7rZWyPuPU0vFYzX0HUctu/w3nZNfSAyvk4SRqM3O20gQ5F2qEbA7fLgZe2RT6BZ+eTg2BSR+/8o6yokmZD4I8EDFID+Gg==',key_name='tempest-keypair-1246137019',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:28:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-k4yk55dk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:28:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=a3fc75bd-80db-491e-9881-0278c38f5a1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "841c9e78-cf44-4004-94ec-120508987a24", "address": "fa:16:3e:0e:06:20", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841c9e78-cf", "ovs_interfaceid": "841c9e78-cf44-4004-94ec-120508987a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:06:20,bridge_name='br-int',has_traffic_filtering=True,id=841c9e78-cf44-4004-94ec-120508987a24,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841c9e78-cf') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG os_vif [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:06:20,bridge_name='br-int',has_traffic_filtering=True,id=841c9e78-cf44-4004-94ec-120508987a24,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841c9e78-cf') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap841c9e78-cf, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=568cb306-dbb6-4923-a168-70f706eac351) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:31:07 user nova-compute[75342]: INFO os_vif [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:06:20,bridge_name='br-int',has_traffic_filtering=True,id=841c9e78-cf44-4004-94ec-120508987a24,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841c9e78-cf')
Nov 16 18:31:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Deleting instance files /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a_del
Nov 16 18:31:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Deletion of /opt/stack/data/nova/instances/a3fc75bd-80db-491e-9881-0278c38f5a1a_del complete
Nov 16 18:31:07 user nova-compute[75342]: INFO nova.compute.manager [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 16 18:31:07 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:31:07 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Took 0.68 seconds to deallocate network for instance.
Nov 16 18:31:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-cfc3c2a6-8cf1-4434-b302-3fd004859c68 req-2ae42d65-4815-476d-a047-1ddd21b195e2 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Received event network-vif-deleted-841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:31:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:31:08 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:31:08 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:31:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:31:08 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Deleted allocations for instance a3fc75bd-80db-491e-9881-0278c38f5a1a
Nov 16 18:31:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1c9c291b-2efd-4d93-b7ea-c5b39a718298 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.829s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:31:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-a2356832-d2c9-4192-b9db-66a42092a657 req-c5891b88-1d71-484f-836c-23a5bf1eeaa3 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Received event network-vif-plugged-841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:31:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2356832-d2c9-4192-b9db-66a42092a657 req-c5891b88-1d71-484f-836c-23a5bf1eeaa3 service nova] Acquiring lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:31:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2356832-d2c9-4192-b9db-66a42092a657 req-c5891b88-1d71-484f-836c-23a5bf1eeaa3 service nova] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:31:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a2356832-d2c9-4192-b9db-66a42092a657 req-c5891b88-1d71-484f-836c-23a5bf1eeaa3 service nova] Lock "a3fc75bd-80db-491e-9881-0278c38f5a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:31:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-a2356832-d2c9-4192-b9db-66a42092a657 req-c5891b88-1d71-484f-836c-23a5bf1eeaa3 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] No waiting events found dispatching network-vif-plugged-841c9e78-cf44-4004-94ec-120508987a24 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:31:08 user nova-compute[75342]: WARNING nova.compute.manager [req-a2356832-d2c9-4192-b9db-66a42092a657 req-c5891b88-1d71-484f-836c-23a5bf1eeaa3 service nova] [instance: a3fc75bd-80db-491e-9881-0278c38f5a1a] Received unexpected event network-vif-plugged-841c9e78-cf44-4004-94ec-120508987a24 for instance with vm_state deleted and task_state None.
Nov 16 18:31:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:31:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:31:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:31:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:31:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:31:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:31:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:31:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:57 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:31:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:31:58 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:31:59 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:31:59 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:32:00 user nova-compute[75342]: INFO nova.compute.claims [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Claim successful on node user
Nov 16 18:32:00 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG nova.network.neutron [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:32:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:32:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG nova.policy [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6df4253086b4db8b675a6e1b2436b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af578b4b43744644b720ab37606f9752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:32:00 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Creating image(s)
Nov 16 18:32:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "/opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "/opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "/opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:32:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.182s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk 1073741824" returned: 0 in 0.055s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG nova.network.neutron [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Successfully created port: c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Cannot resize image /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Ensure instance console log exists: /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG nova.network.neutron [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Successfully updated port: c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquired lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:32:01 user nova-compute[75342]: DEBUG nova.network.neutron [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-b62e424c-734a-4601-9d30-bc5b81cb385c req-c1739472-f3cd-4c07-b40d-ff03d2433fe4 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Received event network-changed-c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-b62e424c-734a-4601-9d30-bc5b81cb385c req-c1739472-f3cd-4c07-b40d-ff03d2433fe4 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Refreshing instance network info cache due to event network-changed-c68a76ac-018e-4dff-b242-0381fbdcd6db. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b62e424c-734a-4601-9d30-bc5b81cb385c req-c1739472-f3cd-4c07-b40d-ff03d2433fe4 service nova] Acquiring lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.network.neutron [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Updating instance_info_cache with network_info: [{"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Releasing lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Instance network_info: |[{"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b62e424c-734a-4601-9d30-bc5b81cb385c req-c1739472-f3cd-4c07-b40d-ff03d2433fe4 service nova] Acquired lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.network.neutron [req-b62e424c-734a-4601-9d30-bc5b81cb385c req-c1739472-f3cd-4c07-b40d-ff03d2433fe4 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Refreshing network info cache for port c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Start _get_guest_xml network_info=[{"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:32:02 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:32:02 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1256895315',display_name='tempest-AttachVolumeNegativeTest-server-1256895315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1256895315',id=51,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2+YWPlpuWG6fgwhjOwbQ7ARQ9uHRus7NIRANb5r6ja9dgi7w7G4xYxLZP1TcKH/Cl8xD5bUrP/KUvqW06frAqbTaIwGgK2fl66Sf2wgb+SIKSFGCSM/Mf+1CCxQJcB1g==',key_name='tempest-keypair-1772039019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-pr5hpw8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=69f7b2a8-ab8e-451b-93ac-0e4ec3112465,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ee:71,bridge_name='br-int',has_traffic_filtering=True,id=c68a76ac-018e-4dff-b242-0381fbdcd6db,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68a76ac-01') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.objects.instance [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'pci_devices' on Instance uuid 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:32:02 user nova-compute[75342]:   <uuid>69f7b2a8-ab8e-451b-93ac-0e4ec3112465</uuid>
Nov 16 18:32:02 user nova-compute[75342]:   <name>instance-00000033</name>
Nov 16 18:32:02 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:32:02 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:32:02 user nova-compute[75342]:   <metadata>
Nov 16 18:32:02 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:32:02 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:32:02 user nova-compute[75342]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1256895315</nova:name>
Nov 16 18:32:02 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:32:02</nova:creationTime>
Nov 16 18:32:02 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:32:02 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:32:02 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:32:02 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:32:02 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:32:02 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:32:02 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:32:02 user nova-compute[75342]:       <nova:owner>
Nov 16 18:32:02 user nova-compute[75342]:         <nova:user uuid="c6df4253086b4db8b675a6e1b2436b87">tempest-AttachVolumeNegativeTest-825910471-project-member</nova:user>
Nov 16 18:32:02 user nova-compute[75342]:         <nova:project uuid="af578b4b43744644b720ab37606f9752">tempest-AttachVolumeNegativeTest-825910471</nova:project>
Nov 16 18:32:02 user nova-compute[75342]:       </nova:owner>
Nov 16 18:32:02 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:32:02 user nova-compute[75342]:       <nova:ports>
Nov 16 18:32:02 user nova-compute[75342]:         <nova:port uuid="c68a76ac-018e-4dff-b242-0381fbdcd6db">
Nov 16 18:32:02 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 18:32:02 user nova-compute[75342]:         </nova:port>
Nov 16 18:32:02 user nova-compute[75342]:       </nova:ports>
Nov 16 18:32:02 user nova-compute[75342]:     </nova:instance>
Nov 16 18:32:02 user nova-compute[75342]:   </metadata>
Nov 16 18:32:02 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:32:02 user nova-compute[75342]:     <system>
Nov 16 18:32:02 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:32:02 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:32:02 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:32:02 user nova-compute[75342]:       <entry name="serial">69f7b2a8-ab8e-451b-93ac-0e4ec3112465</entry>
Nov 16 18:32:02 user nova-compute[75342]:       <entry name="uuid">69f7b2a8-ab8e-451b-93ac-0e4ec3112465</entry>
Nov 16 18:32:02 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:32:02 user nova-compute[75342]:     </system>
Nov 16 18:32:02 user nova-compute[75342]:   </sysinfo>
Nov 16 18:32:02 user nova-compute[75342]:   <os>
Nov 16 18:32:02 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:32:02 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:32:02 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:32:02 user nova-compute[75342]:   </os>
Nov 16 18:32:02 user nova-compute[75342]:   <features>
Nov 16 18:32:02 user nova-compute[75342]:     <acpi/>
Nov 16 18:32:02 user nova-compute[75342]:     <apic/>
Nov 16 18:32:02 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:32:02 user nova-compute[75342]:   </features>
Nov 16 18:32:02 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:32:02 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:32:02 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:32:02 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:32:02 user nova-compute[75342]:   </clock>
Nov 16 18:32:02 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:32:02 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:32:02 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:32:02 user nova-compute[75342]:   </cpu>
Nov 16 18:32:02 user nova-compute[75342]:   <devices>
Nov 16 18:32:02 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:32:02 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:32:02 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk"/>
Nov 16 18:32:02 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:32:02 user nova-compute[75342]:     </disk>
Nov 16 18:32:02 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:32:02 user nova-compute[75342]:       <mac address="fa:16:3e:da:ee:71"/>
Nov 16 18:32:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:32:02 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:32:02 user nova-compute[75342]:       <target dev="tapc68a76ac-01"/>
Nov 16 18:32:02 user nova-compute[75342]:     </interface>
Nov 16 18:32:02 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:32:02 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/console.log" append="off"/>
Nov 16 18:32:02 user nova-compute[75342]:     </serial>
Nov 16 18:32:02 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:32:02 user nova-compute[75342]:     <video>
Nov 16 18:32:02 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:32:02 user nova-compute[75342]:     </video>
Nov 16 18:32:02 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:32:02 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:32:02 user nova-compute[75342]:     </rng>
Nov 16 18:32:02 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:32:02 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:32:02 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:32:02 user nova-compute[75342]:     </memballoon>
Nov 16 18:32:02 user nova-compute[75342]:   </devices>
Nov 16 18:32:02 user nova-compute[75342]: </domain>
Nov 16 18:32:02 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1256895315',display_name='tempest-AttachVolumeNegativeTest-server-1256895315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1256895315',id=51,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2+YWPlpuWG6fgwhjOwbQ7ARQ9uHRus7NIRANb5r6ja9dgi7w7G4xYxLZP1TcKH/Cl8xD5bUrP/KUvqW06frAqbTaIwGgK2fl66Sf2wgb+SIKSFGCSM/Mf+1CCxQJcB1g==',key_name='tempest-keypair-1772039019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-pr5hpw8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=69f7b2a8-ab8e-451b-93ac-0e4ec3112465,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ee:71,bridge_name='br-int',has_traffic_filtering=True,id=c68a76ac-018e-4dff-b242-0381fbdcd6db,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68a76ac-01') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG os_vif [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ee:71,bridge_name='br-int',has_traffic_filtering=True,id=c68a76ac-018e-4dff-b242-0381fbdcd6db,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68a76ac-01') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3aee98c-5932-5f2f-a107-d951457ad694', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc68a76ac-01, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc68a76ac-01, col_values=(('qos', UUID('173bf17a-6332-4e61-9cb4-352429bb30b9')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc68a76ac-01, col_values=(('external_ids', {'iface-id': 'c68a76ac-018e-4dff-b242-0381fbdcd6db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:ee:71', 'vm-uuid': '69f7b2a8-ab8e-451b-93ac-0e4ec3112465'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:02 user nova-compute[75342]: INFO os_vif [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ee:71,bridge_name='br-int',has_traffic_filtering=True,id=c68a76ac-018e-4dff-b242-0381fbdcd6db,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68a76ac-01')
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No VIF found with MAC fa:16:3e:da:ee:71, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.network.neutron [req-b62e424c-734a-4601-9d30-bc5b81cb385c req-c1739472-f3cd-4c07-b40d-ff03d2433fe4 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Updated VIF entry in instance network info cache for port c68a76ac-018e-4dff-b242-0381fbdcd6db. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG nova.network.neutron [req-b62e424c-734a-4601-9d30-bc5b81cb385c req-c1739472-f3cd-4c07-b40d-ff03d2433fe4 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Updating instance_info_cache with network_info: [{"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:32:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-b62e424c-734a-4601-9d30-bc5b81cb385c req-c1739472-f3cd-4c07-b40d-ff03d2433fe4 service nova] Releasing lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:32:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-fae1260c-7056-4260-bea4-e06a771d20b1 req-6ea45bf8-46e5-4f50-ab14-7ec9994e4f5b service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Received event network-vif-plugged-c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fae1260c-7056-4260-bea4-e06a771d20b1 req-6ea45bf8-46e5-4f50-ab14-7ec9994e4f5b service nova] Acquiring lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fae1260c-7056-4260-bea4-e06a771d20b1 req-6ea45bf8-46e5-4f50-ab14-7ec9994e4f5b service nova] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fae1260c-7056-4260-bea4-e06a771d20b1 req-6ea45bf8-46e5-4f50-ab14-7ec9994e4f5b service nova] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-fae1260c-7056-4260-bea4-e06a771d20b1 req-6ea45bf8-46e5-4f50-ab14-7ec9994e4f5b service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] No waiting events found dispatching network-vif-plugged-c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:32:04 user nova-compute[75342]: WARNING nova.compute.manager [req-fae1260c-7056-4260-bea4-e06a771d20b1 req-6ea45bf8-46e5-4f50-ab14-7ec9994e4f5b service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Received unexpected event network-vif-plugged-c68a76ac-018e-4dff-b242-0381fbdcd6db for instance with vm_state building and task_state spawning.
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Skipping network cache update for instance because it is Building. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating instance_info_cache with network_info: [{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:32:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG nova.compute.manager [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:32:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Instance spawned successfully.
Nov 16 18:32:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:32:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:32:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=25.07666778564453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:32:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:32:06 user nova-compute[75342]: INFO nova.compute.manager [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-fafcaf75-596f-4c89-8594-2c3bb5f8e434 req-0472d22c-d997-423e-881f-87e514c8e504 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Received event network-vif-plugged-c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fafcaf75-596f-4c89-8594-2c3bb5f8e434 req-0472d22c-d997-423e-881f-87e514c8e504 service nova] Acquiring lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fafcaf75-596f-4c89-8594-2c3bb5f8e434 req-0472d22c-d997-423e-881f-87e514c8e504 service nova] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fafcaf75-596f-4c89-8594-2c3bb5f8e434 req-0472d22c-d997-423e-881f-87e514c8e504 service nova] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-fafcaf75-596f-4c89-8594-2c3bb5f8e434 req-0472d22c-d997-423e-881f-87e514c8e504 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] No waiting events found dispatching network-vif-plugged-c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:32:06 user nova-compute[75342]: WARNING nova.compute.manager [req-fafcaf75-596f-4c89-8594-2c3bb5f8e434 req-0472d22c-d997-423e-881f-87e514c8e504 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Received unexpected event network-vif-plugged-c68a76ac-018e-4dff-b242-0381fbdcd6db for instance with vm_state building and task_state spawning.
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:32:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:32:06 user nova-compute[75342]: INFO nova.compute.manager [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Took 5.83 seconds to build instance.
Nov 16 18:32:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-697290b8-f2ca-447b-ac27-52e79634362a tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.921s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:32:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-8bfa64c8-de5a-4047-9dc5-a261a20732c1 req-e83d77bb-8d49-41ea-80b4-846279e9d67a service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-changed-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:32:07 user nova-compute[75342]: DEBUG nova.compute.manager [req-8bfa64c8-de5a-4047-9dc5-a261a20732c1 req-e83d77bb-8d49-41ea-80b4-846279e9d67a service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Refreshing instance network info cache due to event network-changed-b32c9b69-9ea2-4252-9875-79c211203004. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:32:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8bfa64c8-de5a-4047-9dc5-a261a20732c1 req-e83d77bb-8d49-41ea-80b4-846279e9d67a service nova] Acquiring lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:32:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8bfa64c8-de5a-4047-9dc5-a261a20732c1 req-e83d77bb-8d49-41ea-80b4-846279e9d67a service nova] Acquired lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:32:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-8bfa64c8-de5a-4047-9dc5-a261a20732c1 req-e83d77bb-8d49-41ea-80b4-846279e9d67a service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Refreshing network info cache for port b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:32:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:07 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:32:07 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:32:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-8bfa64c8-de5a-4047-9dc5-a261a20732c1 req-e83d77bb-8d49-41ea-80b4-846279e9d67a service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updated VIF entry in instance network info cache for port b32c9b69-9ea2-4252-9875-79c211203004. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:32:07 user nova-compute[75342]: DEBUG nova.network.neutron [req-8bfa64c8-de5a-4047-9dc5-a261a20732c1 req-e83d77bb-8d49-41ea-80b4-846279e9d67a service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating instance_info_cache with network_info: [{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:32:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-8bfa64c8-de5a-4047-9dc5-a261a20732c1 req-e83d77bb-8d49-41ea-80b4-846279e9d67a service nova] Releasing lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:32:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-c87944d5-b1ae-4ea6-9d41-2b58be363f16 req-63731849-5880-47b8-8da4-80f5234d169a service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-changed-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:32:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-c87944d5-b1ae-4ea6-9d41-2b58be363f16 req-63731849-5880-47b8-8da4-80f5234d169a service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Refreshing instance network info cache due to event network-changed-b32c9b69-9ea2-4252-9875-79c211203004. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:32:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c87944d5-b1ae-4ea6-9d41-2b58be363f16 req-63731849-5880-47b8-8da4-80f5234d169a service nova] Acquiring lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:32:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c87944d5-b1ae-4ea6-9d41-2b58be363f16 req-63731849-5880-47b8-8da4-80f5234d169a service nova] Acquired lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:32:08 user nova-compute[75342]: DEBUG nova.network.neutron [req-c87944d5-b1ae-4ea6-9d41-2b58be363f16 req-63731849-5880-47b8-8da4-80f5234d169a service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Refreshing network info cache for port b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:32:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:32:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:32:08 user nova-compute[75342]: INFO nova.compute.manager [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Detaching volume 87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f
Nov 16 18:32:08 user nova-compute[75342]: DEBUG nova.network.neutron [req-c87944d5-b1ae-4ea6-9d41-2b58be363f16 req-63731849-5880-47b8-8da4-80f5234d169a service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updated VIF entry in instance network info cache for port b32c9b69-9ea2-4252-9875-79c211203004. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:32:08 user nova-compute[75342]: DEBUG nova.network.neutron [req-c87944d5-b1ae-4ea6-9d41-2b58be363f16 req-63731849-5880-47b8-8da4-80f5234d169a service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating instance_info_cache with network_info: [{"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:32:08 user nova-compute[75342]: INFO nova.virt.block_device [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Attempting to driver detach volume 87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f from mountpoint /dev/vdb
Nov 16 18:32:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c87944d5-b1ae-4ea6-9d41-2b58be363f16 req-63731849-5880-47b8-8da4-80f5234d169a service nova] Releasing lock "refresh_cache-795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:32:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Attempting to detach device vdb from instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:32:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:32:08 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:32:08 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:32:08 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:32:08 user nova-compute[75342]:   <serial>87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f</serial>
Nov 16 18:32:08 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 18:32:08 user nova-compute[75342]: </disk>
Nov 16 18:32:08 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:32:08 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Successfully detached device vdb from instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d from the persistent domain config.
Nov 16 18:32:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:32:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:32:08 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:32:08 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:32:08 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:32:08 user nova-compute[75342]:   <serial>87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f</serial>
Nov 16 18:32:08 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 18:32:08 user nova-compute[75342]: </disk>
Nov 16 18:32:08 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:32:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:09 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:32:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:32:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:32:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:32:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:29 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d is timed out.
Nov 16 18:32:29 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Successfully detached device vdb from instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d from the live domain config.
Nov 16 18:32:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyQpiRWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:32:29 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde0788d-d97c-40cc-8c66-ff9a9252a41c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:32:29 user nova-compute[75342]: No targets found.
Nov 16 18:32:29 user nova-compute[75342]: iSNS:
Nov 16 18:32:29 user nova-compute[75342]: No targets found.
Nov 16 18:32:29 user nova-compute[75342]: STATIC:
Nov 16 18:32:29 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f
Nov 16 18:32:29 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:32:29 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:32:29 user nova-compute[75342]: FIRMWARE:
Nov 16 18:32:29 user nova-compute[75342]: No targets found.
Nov 16 18:32:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:32:29 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:32:29 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[126f551f-6690-4ba3-ae9b-2bb6e95fb25b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc0e170-0766-4c4e-8415-f2355cad921e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:32:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f (non-flash)
Nov 16 18:32:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a45631c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc19a5e-4e44-4f0b-ae2c-8c387f305e22]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6340d6-ffb7-47eb-af5e-7b6e14ecf6c3]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d146e-8045-41fb-ae21-0662c1b8b061]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[287f4dd8-4ecd-4545-852e-541ac7e998d3]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[be30e9a8-f52c-428d-a4d0-c594e9443ccc]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a72337-daed-4c6c-a658-cc0acc580a7f]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260]
Nov 16 18:32:29 user nova-compute[75342]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f, portal: 172.16.0.220,3260] successful.
Nov 16 18:32:29 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87f97b72-8aa6-4a8e-8d64-c4d8d1fde91f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81dcfad-e65d-4a31-9c90-d4d0bac17086]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] <== disconnect_volume: return (277ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:32:29 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:32:30 user nova-compute[75342]: DEBUG nova.objects.instance [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'flavor' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:32:30 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-144388f9-4e66-4364-885a-d137c7a4e5e9 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.660s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:32:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:32:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:32:58 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:33:00 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:33:00 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:33:00 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:33:00 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:33:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:03 user nova-compute[75342]: INFO nova.compute.manager [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Terminating instance
Nov 16 18:33:03 user nova-compute[75342]: DEBUG nova.compute.manager [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-571185fe-d1f1-4685-93a5-4685d5e4bf68 req-99c0b8fd-f08a-4f49-a83f-e35ae6f39e1f service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-vif-unplugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-571185fe-d1f1-4685-93a5-4685d5e4bf68 req-99c0b8fd-f08a-4f49-a83f-e35ae6f39e1f service nova] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-571185fe-d1f1-4685-93a5-4685d5e4bf68 req-99c0b8fd-f08a-4f49-a83f-e35ae6f39e1f service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-571185fe-d1f1-4685-93a5-4685d5e4bf68 req-99c0b8fd-f08a-4f49-a83f-e35ae6f39e1f service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-571185fe-d1f1-4685-93a5-4685d5e4bf68 req-99c0b8fd-f08a-4f49-a83f-e35ae6f39e1f service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] No waiting events found dispatching network-vif-unplugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG nova.compute.manager [req-571185fe-d1f1-4685-93a5-4685d5e4bf68 req-99c0b8fd-f08a-4f49-a83f-e35ae6f39e1f service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-vif-unplugged-b32c9b69-9ea2-4252-9875-79c211203004 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:33:03 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:04 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Instance destroyed successfully.
Nov 16 18:33:04 user nova-compute[75342]: DEBUG nova.objects.instance [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'resources' on Instance uuid 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-189132045',display_name='tempest-TestMinimumBasicScenario-server-189132045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-189132045',id=49,image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdpCPMhK+mW91pY5GzHNS++TI0FODU8JgMhFRCrrFSM7Wq3X4ItO4mnYKoc2+Ddc8qpCv4zK75Tog5oEd3uRpljrseAx9CYal7POT3oMYf94PmIkncBEEvtwpihCw79yA==',key_name='tempest-TestMinimumBasicScenario-1558201364',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='556d660660644cceb015589ace168ca5',ramdisk_id='',reservation_id='r-h0uprm83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8cab68af-d6b4-49cb-a8f5-631837b3c042',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2125212492',owner_user_name='tempest-TestMinimumBasicScenario-2125212492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:30:23Z,user_data=None,user_id='752db55aae8e42508a2b5df43e7019f0',uuid=795db5c6-b8bf-45d8-8eff-ebbb664f6f0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converting VIF {"id": "b32c9b69-9ea2-4252-9875-79c211203004", "address": "fa:16:3e:8d:4a:6c", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c9b69-9e", "ovs_interfaceid": "b32c9b69-9ea2-4252-9875-79c211203004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG os_vif [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb32c9b69-9e, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c68f67dc-fa49-4cec-bf70-8eff65dc4dcc) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:33:04 user nova-compute[75342]: INFO os_vif [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b32c9b69-9ea2-4252-9875-79c211203004,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c9b69-9e')
Nov 16 18:33:04 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Deleting instance files /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d_del
Nov 16 18:33:04 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Deletion of /opt/stack/data/nova/instances/795db5c6-b8bf-45d8-8eff-ebbb664f6f0d_del complete
Nov 16 18:33:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:33:04 user nova-compute[75342]: INFO nova.compute.manager [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 18:33:04 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:04 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Error from libvirt while getting description of instance-00000031: [Error Code 42] Domain not found: no domain with matching uuid '795db5c6-b8bf-45d8-8eff-ebbb664f6f0d' (instance-00000031): libvirt.libvirtError: Domain not found: no domain with matching uuid '795db5c6-b8bf-45d8-8eff-ebbb664f6f0d' (instance-00000031)
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-8b864413-508f-41d3-a3ff-ee595e000031 req-367ac213-2490-4ac9-ae8d-e995dff68cba service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-vif-deleted-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:33:05 user nova-compute[75342]: INFO nova.compute.manager [req-8b864413-508f-41d3-a3ff-ee595e000031 req-367ac213-2490-4ac9-ae8d-e995dff68cba service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Neutron deleted interface b32c9b69-9ea2-4252-9875-79c211203004; detaching it from the instance and deleting it from the info cache
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.network.neutron [req-8b864413-508f-41d3-a3ff-ee595e000031 req-367ac213-2490-4ac9-ae8d-e995dff68cba service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:33:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:33:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=25.07574462890625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-8b864413-508f-41d3-a3ff-ee595e000031 req-367ac213-2490-4ac9-ae8d-e995dff68cba service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Detach interface failed, port_id=b32c9b69-9ea2-4252-9875-79c211203004, reason: Instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d could not be found. {{(pid=75342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 18:33:05 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Took 0.85 seconds to deallocate network for instance.
Nov 16 18:33:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.139s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:05 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Deleted allocations for instance 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d
Nov 16 18:33:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-34770510-0928-4f9c-ae29-dfb15e59e0f8 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.233s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-efa46316-139a-447d-a0bc-78ba66ec2ba5 req-74937df7-00e9-4686-8d80-f8a428f3c3f9 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-efa46316-139a-447d-a0bc-78ba66ec2ba5 req-74937df7-00e9-4686-8d80-f8a428f3c3f9 service nova] Acquiring lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-efa46316-139a-447d-a0bc-78ba66ec2ba5 req-74937df7-00e9-4686-8d80-f8a428f3c3f9 service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-efa46316-139a-447d-a0bc-78ba66ec2ba5 req-74937df7-00e9-4686-8d80-f8a428f3c3f9 service nova] Lock "795db5c6-b8bf-45d8-8eff-ebbb664f6f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:05 user nova-compute[75342]: DEBUG nova.compute.manager [req-efa46316-139a-447d-a0bc-78ba66ec2ba5 req-74937df7-00e9-4686-8d80-f8a428f3c3f9 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] No waiting events found dispatching network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:33:05 user nova-compute[75342]: WARNING nova.compute.manager [req-efa46316-139a-447d-a0bc-78ba66ec2ba5 req-74937df7-00e9-4686-8d80-f8a428f3c3f9 service nova] [instance: 795db5c6-b8bf-45d8-8eff-ebbb664f6f0d] Received unexpected event network-vif-plugged-b32c9b69-9ea2-4252-9875-79c211203004 for instance with vm_state deleted and task_state None.
Nov 16 18:33:07 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:33:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:33:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:33:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:33:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:33:07 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:33:07 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:33:07 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Updating instance_info_cache with network_info: [{"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:33:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:33:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:33:07 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:33:07 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:33:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:33:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:33:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:33:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:33:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:33:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:33:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:33:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:33:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:33:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:33:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:33:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-fc427eb0-9037-4180-9812-32fbd6a6907d req-1e87d06b-8863-4768-b34f-9de5354b7c30 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Received event network-changed-c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:33:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-fc427eb0-9037-4180-9812-32fbd6a6907d req-1e87d06b-8863-4768-b34f-9de5354b7c30 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Refreshing instance network info cache due to event network-changed-c68a76ac-018e-4dff-b242-0381fbdcd6db. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:33:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fc427eb0-9037-4180-9812-32fbd6a6907d req-1e87d06b-8863-4768-b34f-9de5354b7c30 service nova] Acquiring lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:33:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fc427eb0-9037-4180-9812-32fbd6a6907d req-1e87d06b-8863-4768-b34f-9de5354b7c30 service nova] Acquired lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:33:51 user nova-compute[75342]: DEBUG nova.network.neutron [req-fc427eb0-9037-4180-9812-32fbd6a6907d req-1e87d06b-8863-4768-b34f-9de5354b7c30 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Refreshing network info cache for port c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:33:52 user nova-compute[75342]: DEBUG nova.network.neutron [req-fc427eb0-9037-4180-9812-32fbd6a6907d req-1e87d06b-8863-4768-b34f-9de5354b7c30 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Updated VIF entry in instance network info cache for port c68a76ac-018e-4dff-b242-0381fbdcd6db. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:33:52 user nova-compute[75342]: DEBUG nova.network.neutron [req-fc427eb0-9037-4180-9812-32fbd6a6907d req-1e87d06b-8863-4768-b34f-9de5354b7c30 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Updating instance_info_cache with network_info: [{"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:33:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-fc427eb0-9037-4180-9812-32fbd6a6907d req-1e87d06b-8863-4768-b34f-9de5354b7c30 service nova] Releasing lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG nova.objects.instance [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'flavor' on Instance uuid 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:54 user nova-compute[75342]: INFO nova.compute.manager [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Attaching volume 54f848c6-2cc1-4fd1-9d85-001c52a48302 to /dev/vdb
Nov 16 18:33:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG os_brick.utils [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f243df4-1083-4d7f-a3a4-a8fd9a36f116]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5feb27f5-fefa-4c5c-897a-74b8165b0e75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2640ddde-4823-4777-aad0-c7045301d021]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0a79a8-5edc-47e5-bf78-f1984b9d3f40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:33:54 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:33:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[725fdab0-68a3-4ac7-b3ce-510d3a9eea33]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG os_brick.utils [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:33:54 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Updating existing volume attachment record: 7a4c911f-fa1c-4e96-a833-ae088e604bef {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:33:57 user nova-compute[75342]: INFO nova.compute.claims [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Claim successful on node user
Nov 16 18:33:57 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG nova.network.neutron [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:33:57 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:33:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG nova.policy [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '752db55aae8e42508a2b5df43e7019f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556d660660644cceb015589ace168ca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG nova.compute.manager [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:33:57 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Creating image(s)
Nov 16 18:33:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "/opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "/opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "/opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "e03e7c728286df063197546fbdeb9bb40f5ba449" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "e03e7c728286df063197546fbdeb9bb40f5ba449" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449.part --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:58 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:33:58 user nova-compute[75342]: DEBUG nova.network.neutron [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Successfully created port: 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:33:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449.part --force-share --output=json" returned: 0 in 0.287s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:58 user nova-compute[75342]: DEBUG nova.virt.images [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] ec01624a-c6f0-4ca4-85bf-7b8cba4d816a was qcow2, converting to raw {{(pid=75342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 18:33:58 user nova-compute[75342]: DEBUG nova.privsep.utils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 18:33:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449.part /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449.converted {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG nova.network.neutron [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Successfully updated port: 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449.part /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449.converted" returned: 0 in 0.468s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449.converted --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquired lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG nova.network.neutron [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG nova.compute.manager [req-623b27ea-6e19-4299-9cec-6d9cfb8cb99d req-500f3383-e82f-4b25-a100-4d9e2642d12b service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-changed-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG nova.compute.manager [req-623b27ea-6e19-4299-9cec-6d9cfb8cb99d req-500f3383-e82f-4b25-a100-4d9e2642d12b service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Refreshing instance network info cache due to event network-changed-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-623b27ea-6e19-4299-9cec-6d9cfb8cb99d req-500f3383-e82f-4b25-a100-4d9e2642d12b service nova] Acquiring lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CzjtvxqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:33:59 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:33:59 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:33:59 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ee676c-9df2-4bc2-988f-59e188972021]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:33:59 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG nova.network.neutron [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c04086-726f-4676-b7ca-3d0bbb2d86f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302] added
Nov 16 18:33:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.063s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39da8ce-6596-43b0-a016-cbc55356c097]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449.converted --force-share --output=json" returned: 0 in 0.230s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "e03e7c728286df063197546fbdeb9bb40f5ba449" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.467s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ef7438-30ec-4888-8fbf-ca674ef0d70f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CzjtvxqJ {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CzjtvxqJ" returned: 0 in 0.034s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1705f1b5-abb3-4ea5-8387-ac9cb2d5e806]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CzjtvxqJ'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c66c460-e445-4efb-ae01-ab90aaf8cfd1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d3364f-8b2c-47ee-807d-883d8eafe73c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:33:59 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:33:59 user nova-compute[75342]:  {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:33:59 user nova-compute[75342]: WARNING os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 18:33:59 user nova-compute[75342]: 
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449 --force-share --output=json" returned: 0 in 0.168s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "e03e7c728286df063197546fbdeb9bb40f5ba449" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "e03e7c728286df063197546fbdeb9bb40f5ba449" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[501f1e13-1733-4f5e-a5c3-3a1484f65ce0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302, portal: 172.16.0.220,3260]
Nov 16 18:33:59 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302, portal: 172.16.0.220,3260] successful.
Nov 16 18:33:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG nova.network.neutron [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[80361e70-b3a9-4b98-9bd3-3933105b16a7]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Releasing lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG nova.compute.manager [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Instance network_info: |[{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-623b27ea-6e19-4299-9cec-6d9cfb8cb99d req-500f3383-e82f-4b25-a100-4d9e2642d12b service nova] Acquired lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG nova.network.neutron [req-623b27ea-6e19-4299-9cec-6d9cfb8cb99d req-500f3383-e82f-4b25-a100-4d9e2642d12b service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Refreshing network info cache for port 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d21fb8e-bc78-4634-841a-0c541bb6471f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 (non-flash)
Nov 16 18:33:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 (non-flash)
Nov 16 18:33:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eaef04-6b36-4853-9072-7e1e9b8e428d]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CzjtvxqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449 --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449,backing_fmt=raw /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449,backing_fmt=raw /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk 1073741824" returned: 0 in 0.075s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "e03e7c728286df063197546fbdeb9bb40f5ba449" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:33:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449 --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449 --force-share --output=json" returned: 0 in 0.189s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.network.neutron [req-623b27ea-6e19-4299-9cec-6d9cfb8cb99d req-500f3383-e82f-4b25-a100-4d9e2642d12b service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updated VIF entry in instance network info cache for port 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.network.neutron [req-623b27ea-6e19-4299-9cec-6d9cfb8cb99d req-500f3383-e82f-4b25-a100-4d9e2642d12b service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-623b27ea-6e19-4299-9cec-6d9cfb8cb99d req-500f3383-e82f-4b25-a100-4d9e2642d12b service nova] Releasing lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Cannot resize image /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Ensure instance console log exists: /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Start _get_guest_xml network_info=[{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T18:33:55Z,direct_url=<?>,disk_format='qcow2',id=ec01624a-c6f0-4ca4-85bf-7b8cba4d816a,min_disk=0,min_ram=0,name='tempest-scenario-img--1180440766',owner='556d660660644cceb015589ace168ca5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T18:33:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'ec01624a-c6f0-4ca4-85bf-7b8cba4d816a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:34:00 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:34:00 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T18:33:55Z,direct_url=<?>,disk_format='qcow2',id=ec01624a-c6f0-4ca4-85bf-7b8cba4d816a,min_disk=0,min_ram=0,name='tempest-scenario-img--1180440766',owner='556d660660644cceb015589ace168ca5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T18:33:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-877683055',display_name='tempest-TestMinimumBasicScenario-server-877683055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-877683055',id=52,image_ref='ec01624a-c6f0-4ca4-85bf-7b8cba4d816a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJa53iD4kfvIoFu67XM8tLrRfbU0tUanMml9sC2WGp6pZYnDK/1HyMx7P5VGay49uAbU0PwsilG7X4p+os3nvRAkOtiuRAEaMHlZI1RV0ZBAcT6oWKTkEmFMoPKokk2Cw==',key_name='tempest-TestMinimumBasicScenario-1873989759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='556d660660644cceb015589ace168ca5',ramdisk_id='',reservation_id='r-h4om7dkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ec01624a-c6f0-4ca4-85bf-7b8cba4d816a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2125212492',owner_user_name='tempest-TestMinimumBasicScenario-2125212492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:33:58Z,user_data=None,user_id='752db55aae8e42508a2b5df43e7019f0',uuid=4981e23c-e326-47ae-bd05-3d31ec08a9a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converting VIF {"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b0:28,bridge_name='br-int',has_traffic_filtering=True,id=3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0d0abd-f5') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.objects.instance [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'pci_devices' on Instance uuid 4981e23c-e326-47ae-bd05-3d31ec08a9a9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:34:00 user nova-compute[75342]:   <uuid>4981e23c-e326-47ae-bd05-3d31ec08a9a9</uuid>
Nov 16 18:34:00 user nova-compute[75342]:   <name>instance-00000034</name>
Nov 16 18:34:00 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:34:00 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:34:00 user nova-compute[75342]:   <metadata>
Nov 16 18:34:00 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:34:00 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:34:00 user nova-compute[75342]:       <nova:name>tempest-TestMinimumBasicScenario-server-877683055</nova:name>
Nov 16 18:34:00 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:34:00</nova:creationTime>
Nov 16 18:34:00 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:34:00 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:34:00 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:34:00 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:34:00 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:34:00 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:34:00 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:34:00 user nova-compute[75342]:       <nova:owner>
Nov 16 18:34:00 user nova-compute[75342]:         <nova:user uuid="752db55aae8e42508a2b5df43e7019f0">tempest-TestMinimumBasicScenario-2125212492-project-member</nova:user>
Nov 16 18:34:00 user nova-compute[75342]:         <nova:project uuid="556d660660644cceb015589ace168ca5">tempest-TestMinimumBasicScenario-2125212492</nova:project>
Nov 16 18:34:00 user nova-compute[75342]:       </nova:owner>
Nov 16 18:34:00 user nova-compute[75342]:       <nova:root type="image" uuid="ec01624a-c6f0-4ca4-85bf-7b8cba4d816a"/>
Nov 16 18:34:00 user nova-compute[75342]:       <nova:ports>
Nov 16 18:34:00 user nova-compute[75342]:         <nova:port uuid="3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6">
Nov 16 18:34:00 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 18:34:00 user nova-compute[75342]:         </nova:port>
Nov 16 18:34:00 user nova-compute[75342]:       </nova:ports>
Nov 16 18:34:00 user nova-compute[75342]:     </nova:instance>
Nov 16 18:34:00 user nova-compute[75342]:   </metadata>
Nov 16 18:34:00 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:34:00 user nova-compute[75342]:     <system>
Nov 16 18:34:00 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:34:00 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:34:00 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:34:00 user nova-compute[75342]:       <entry name="serial">4981e23c-e326-47ae-bd05-3d31ec08a9a9</entry>
Nov 16 18:34:00 user nova-compute[75342]:       <entry name="uuid">4981e23c-e326-47ae-bd05-3d31ec08a9a9</entry>
Nov 16 18:34:00 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:34:00 user nova-compute[75342]:     </system>
Nov 16 18:34:00 user nova-compute[75342]:   </sysinfo>
Nov 16 18:34:00 user nova-compute[75342]:   <os>
Nov 16 18:34:00 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:34:00 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:34:00 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:34:00 user nova-compute[75342]:   </os>
Nov 16 18:34:00 user nova-compute[75342]:   <features>
Nov 16 18:34:00 user nova-compute[75342]:     <acpi/>
Nov 16 18:34:00 user nova-compute[75342]:     <apic/>
Nov 16 18:34:00 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:34:00 user nova-compute[75342]:   </features>
Nov 16 18:34:00 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:34:00 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:34:00 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:34:00 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:34:00 user nova-compute[75342]:   </clock>
Nov 16 18:34:00 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:34:00 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:34:00 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:34:00 user nova-compute[75342]:   </cpu>
Nov 16 18:34:00 user nova-compute[75342]:   <devices>
Nov 16 18:34:00 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:34:00 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:34:00 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk"/>
Nov 16 18:34:00 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:34:00 user nova-compute[75342]:     </disk>
Nov 16 18:34:00 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:34:00 user nova-compute[75342]:       <mac address="fa:16:3e:f1:b0:28"/>
Nov 16 18:34:00 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:34:00 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:34:00 user nova-compute[75342]:       <target dev="tap3e0d0abd-f5"/>
Nov 16 18:34:00 user nova-compute[75342]:     </interface>
Nov 16 18:34:00 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:34:00 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/console.log" append="off"/>
Nov 16 18:34:00 user nova-compute[75342]:     </serial>
Nov 16 18:34:00 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:34:00 user nova-compute[75342]:     <video>
Nov 16 18:34:00 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:34:00 user nova-compute[75342]:     </video>
Nov 16 18:34:00 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:34:00 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:34:00 user nova-compute[75342]:     </rng>
Nov 16 18:34:00 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:34:00 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:34:00 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:34:00 user nova-compute[75342]:     </memballoon>
Nov 16 18:34:00 user nova-compute[75342]:   </devices>
Nov 16 18:34:00 user nova-compute[75342]: </domain>
Nov 16 18:34:00 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-877683055',display_name='tempest-TestMinimumBasicScenario-server-877683055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-877683055',id=52,image_ref='ec01624a-c6f0-4ca4-85bf-7b8cba4d816a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJa53iD4kfvIoFu67XM8tLrRfbU0tUanMml9sC2WGp6pZYnDK/1HyMx7P5VGay49uAbU0PwsilG7X4p+os3nvRAkOtiuRAEaMHlZI1RV0ZBAcT6oWKTkEmFMoPKokk2Cw==',key_name='tempest-TestMinimumBasicScenario-1873989759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='556d660660644cceb015589ace168ca5',ramdisk_id='',reservation_id='r-h4om7dkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ec01624a-c6f0-4ca4-85bf-7b8cba4d816a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2125212492',owner_user_name='tempest-TestMinimumBasicScenario-2125212492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:33:58Z,user_data=None,user_id='752db55aae8e42508a2b5df43e7019f0',uuid=4981e23c-e326-47ae-bd05-3d31ec08a9a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converting VIF {"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b0:28,bridge_name='br-int',has_traffic_filtering=True,id=3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0d0abd-f5') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG os_vif [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b0:28,bridge_name='br-int',has_traffic_filtering=True,id=3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0d0abd-f5') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41e79b75-f2b0-57ad-be06-fa786ebac640', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e0d0abd-f5, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e0d0abd-f5, col_values=(('qos', UUID('53752822-2a57-4a72-96c4-c6ed0341aa58')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e0d0abd-f5, col_values=(('external_ids', {'iface-id': '3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:b0:28', 'vm-uuid': '4981e23c-e326-47ae-bd05-3d31ec08a9a9'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:00 user nova-compute[75342]: INFO os_vif [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b0:28,bridge_name='br-int',has_traffic_filtering=True,id=3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0d0abd-f5')
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] No VIF found with MAC fa:16:3e:f1:b0:28, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '26234333166356330', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234333166356330', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.objects.instance [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'flavor' on Instance uuid 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:34:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:34:00 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:34:00 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:34:00 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:34:00 user nova-compute[75342]:   <serial>54f848c6-2cc1-4fd1-9d85-001c52a48302</serial>
Nov 16 18:34:00 user nova-compute[75342]: </disk>
Nov 16 18:34:00 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:34:01 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:34:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:34:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:34:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] No VIF found with MAC fa:16:3e:da:ee:71, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:34:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-e025b5d3-b7d9-4826-bd17-42a2f54dca01 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.662s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-4af08efc-41a4-4e11-ae8a-adbdd6620b8e req-bdfecfc1-419b-4c01-b6b5-bdbf7709e717 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4af08efc-41a4-4e11-ae8a-adbdd6620b8e req-bdfecfc1-419b-4c01-b6b5-bdbf7709e717 service nova] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4af08efc-41a4-4e11-ae8a-adbdd6620b8e req-bdfecfc1-419b-4c01-b6b5-bdbf7709e717 service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-4af08efc-41a4-4e11-ae8a-adbdd6620b8e req-bdfecfc1-419b-4c01-b6b5-bdbf7709e717 service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-4af08efc-41a4-4e11-ae8a-adbdd6620b8e req-bdfecfc1-419b-4c01-b6b5-bdbf7709e717 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] No waiting events found dispatching network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:34:02 user nova-compute[75342]: WARNING nova.compute.manager [req-4af08efc-41a4-4e11-ae8a-adbdd6620b8e req-bdfecfc1-419b-4c01-b6b5-bdbf7709e717 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received unexpected event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 for instance with vm_state building and task_state spawning.
Nov 16 18:34:02 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:34:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:34:03 user nova-compute[75342]: INFO nova.compute.manager [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Detaching volume 54f848c6-2cc1-4fd1-9d85-001c52a48302
Nov 16 18:34:03 user nova-compute[75342]: INFO nova.virt.block_device [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Attempting to driver detach volume 54f848c6-2cc1-4fd1-9d85-001c52a48302 from mountpoint /dev/vdb
Nov 16 18:34:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Attempting to detach device vdb from instance 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:34:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:34:03 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:34:03 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:34:03 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:34:03 user nova-compute[75342]:   <serial>54f848c6-2cc1-4fd1-9d85-001c52a48302</serial>
Nov 16 18:34:03 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:34:03 user nova-compute[75342]: </disk>
Nov 16 18:34:03 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:34:03 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully detached device vdb from instance 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 from the persistent domain config.
Nov 16 18:34:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:34:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:34:03 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:34:03 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:34:03 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:34:03 user nova-compute[75342]:   <serial>54f848c6-2cc1-4fd1-9d85-001c52a48302</serial>
Nov 16 18:34:03 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:34:03 user nova-compute[75342]: </disk>
Nov 16 18:34:03 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:34:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:34:04 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Instance spawned successfully.
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:34:04 user nova-compute[75342]: INFO nova.compute.manager [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-894312f8-eec3-4338-b178-7eedcbf364d9 req-a9e9278f-a3d9-455d-bad8-ce1c1bb9e867 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-894312f8-eec3-4338-b178-7eedcbf364d9 req-a9e9278f-a3d9-455d-bad8-ce1c1bb9e867 service nova] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-894312f8-eec3-4338-b178-7eedcbf364d9 req-a9e9278f-a3d9-455d-bad8-ce1c1bb9e867 service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-894312f8-eec3-4338-b178-7eedcbf364d9 req-a9e9278f-a3d9-455d-bad8-ce1c1bb9e867 service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG nova.compute.manager [req-894312f8-eec3-4338-b178-7eedcbf364d9 req-a9e9278f-a3d9-455d-bad8-ce1c1bb9e867 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] No waiting events found dispatching network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:34:04 user nova-compute[75342]: WARNING nova.compute.manager [req-894312f8-eec3-4338-b178-7eedcbf364d9 req-a9e9278f-a3d9-455d-bad8-ce1c1bb9e867 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received unexpected event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 for instance with vm_state building and task_state spawning.
Nov 16 18:34:04 user nova-compute[75342]: INFO nova.compute.manager [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Took 6.90 seconds to build instance.
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-82c15991-8fe6-416d-991d-3553cb76140c tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.999s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:34:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:34:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8886MB free_disk=25.052490234375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:34:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:07 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:34:08 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:34:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:34:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:34:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:34:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:34:08 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:34:08 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:34:08 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Updating instance_info_cache with network_info: [{"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:34:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-69f7b2a8-ab8e-451b-93ac-0e4ec3112465" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:34:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:34:08 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:34:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:15 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:18 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:34:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:20 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:23 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 is timed out.
Nov 16 18:34:23 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully detached device vdb from instance 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 from the live domain config.
Nov 16 18:34:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CzjtvxqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:34:23 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d772e6-5e49-4164-aa28-ededed1e0c06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:34:23 user nova-compute[75342]: No targets found.
Nov 16 18:34:23 user nova-compute[75342]: iSNS:
Nov 16 18:34:23 user nova-compute[75342]: No targets found.
Nov 16 18:34:23 user nova-compute[75342]: STATIC:
Nov 16 18:34:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302
Nov 16 18:34:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:34:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:34:23 user nova-compute[75342]: FIRMWARE:
Nov 16 18:34:23 user nova-compute[75342]: No targets found.
Nov 16 18:34:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:34:23 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:34:23 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ba3b2a-c80c-4dd9-8f1f-83d854c4e835]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c693dbb4-062b-4ef9-a0c4-87b6af12d778]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 (non-flash)
Nov 16 18:34:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 (non-flash)
Nov 16 18:34:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a452f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2f95bc-58f7-4642-8f1a-8091d3cb32af]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[276d6368-99e3-4212-9b74-fb1a918dc206]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[129b8269-88b4-4dc4-a522-5cc069d323c2]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c1e336-11d6-40f5-bb3d-ff12406a61c3]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01dfcdb-44e8-4651-823e-296ce83efa22]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe989ba-77fa-4898-bdd0-4c34ef383687]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302, portal: 172.16.0.220,3260]
Nov 16 18:34:23 user nova-compute[75342]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302, portal: 172.16.0.220,3260] successful.
Nov 16 18:34:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f848c6-2cc1-4fd1-9d85-001c52a48302 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee371d66-4daa-4f82-815b-eb51c54dd524]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] <== disconnect_volume: return (317ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:34:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:34:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:24 user nova-compute[75342]: DEBUG nova.objects.instance [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'flavor' on Instance uuid 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:34:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-b615e87b-d9b8-4d7c-9fad-25f3c88a3175 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.804s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:25 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:30 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:35 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:40 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:34:45 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:53 user nova-compute[75342]: INFO nova.compute.manager [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Terminating instance
Nov 16 18:34:53 user nova-compute[75342]: DEBUG nova.compute.manager [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-a320995b-e37c-4586-b259-8a6a127f60ef req-9e4b4031-be4a-4ad0-a509-93161987c53a service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Received event network-vif-unplugged-c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a320995b-e37c-4586-b259-8a6a127f60ef req-9e4b4031-be4a-4ad0-a509-93161987c53a service nova] Acquiring lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a320995b-e37c-4586-b259-8a6a127f60ef req-9e4b4031-be4a-4ad0-a509-93161987c53a service nova] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-a320995b-e37c-4586-b259-8a6a127f60ef req-9e4b4031-be4a-4ad0-a509-93161987c53a service nova] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-a320995b-e37c-4586-b259-8a6a127f60ef req-9e4b4031-be4a-4ad0-a509-93161987c53a service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] No waiting events found dispatching network-vif-unplugged-c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG nova.compute.manager [req-a320995b-e37c-4586-b259-8a6a127f60ef req-9e4b4031-be4a-4ad0-a509-93161987c53a service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Received event network-vif-unplugged-c68a76ac-018e-4dff-b242-0381fbdcd6db for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:34:53 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:54 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Instance destroyed successfully.
Nov 16 18:34:54 user nova-compute[75342]: DEBUG nova.objects.instance [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lazy-loading 'resources' on Instance uuid 69f7b2a8-ab8e-451b-93ac-0e4ec3112465 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1256895315',display_name='tempest-AttachVolumeNegativeTest-server-1256895315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1256895315',id=51,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2+YWPlpuWG6fgwhjOwbQ7ARQ9uHRus7NIRANb5r6ja9dgi7w7G4xYxLZP1TcKH/Cl8xD5bUrP/KUvqW06frAqbTaIwGgK2fl66Sf2wgb+SIKSFGCSM/Mf+1CCxQJcB1g==',key_name='tempest-keypair-1772039019',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af578b4b43744644b720ab37606f9752',ramdisk_id='',reservation_id='r-pr5hpw8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-825910471',owner_user_name='tempest-AttachVolumeNegativeTest-825910471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:32:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6df4253086b4db8b675a6e1b2436b87',uuid=69f7b2a8-ab8e-451b-93ac-0e4ec3112465,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converting VIF {"id": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "address": "fa:16:3e:da:ee:71", "network": {"id": "10d40381-9f02-4712-a4e8-c29bff3bcae5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-10617782-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af578b4b43744644b720ab37606f9752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68a76ac-01", "ovs_interfaceid": "c68a76ac-018e-4dff-b242-0381fbdcd6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:ee:71,bridge_name='br-int',has_traffic_filtering=True,id=c68a76ac-018e-4dff-b242-0381fbdcd6db,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68a76ac-01') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG os_vif [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ee:71,bridge_name='br-int',has_traffic_filtering=True,id=c68a76ac-018e-4dff-b242-0381fbdcd6db,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68a76ac-01') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc68a76ac-01, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=173bf17a-6332-4e61-9cb4-352429bb30b9) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:34:54 user nova-compute[75342]: INFO os_vif [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ee:71,bridge_name='br-int',has_traffic_filtering=True,id=c68a76ac-018e-4dff-b242-0381fbdcd6db,network=Network(10d40381-9f02-4712-a4e8-c29bff3bcae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68a76ac-01')
Nov 16 18:34:54 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Deleting instance files /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465_del
Nov 16 18:34:54 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Deletion of /opt/stack/data/nova/instances/69f7b2a8-ab8e-451b-93ac-0e4ec3112465_del complete
Nov 16 18:34:54 user nova-compute[75342]: INFO nova.compute.manager [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 16 18:34:54 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:34:54 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:34:55 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:34:55 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Took 0.79 seconds to deallocate network for instance.
Nov 16 18:34:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-64d83324-2900-4d2b-9245-c17997d2503d req-794f2e24-4838-4a04-ae99-a63efbb5f104 service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Received event network-vif-deleted-c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:34:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:34:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:34:55 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:34:55 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:34:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:55 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Deleted allocations for instance 69f7b2a8-ab8e-451b-93ac-0e4ec3112465
Nov 16 18:34:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-db2b4008-cd55-498b-83f8-baf333f40ab2 tempest-AttachVolumeNegativeTest-825910471 tempest-AttachVolumeNegativeTest-825910471-project-member] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.210s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-e0f2b61f-ed58-4f87-9d6d-4dbfa954d795 req-6cb5302b-a0e5-4021-a7ee-f405876c61ef service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Received event network-vif-plugged-c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:34:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e0f2b61f-ed58-4f87-9d6d-4dbfa954d795 req-6cb5302b-a0e5-4021-a7ee-f405876c61ef service nova] Acquiring lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:34:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e0f2b61f-ed58-4f87-9d6d-4dbfa954d795 req-6cb5302b-a0e5-4021-a7ee-f405876c61ef service nova] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:34:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e0f2b61f-ed58-4f87-9d6d-4dbfa954d795 req-6cb5302b-a0e5-4021-a7ee-f405876c61ef service nova] Lock "69f7b2a8-ab8e-451b-93ac-0e4ec3112465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:34:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-e0f2b61f-ed58-4f87-9d6d-4dbfa954d795 req-6cb5302b-a0e5-4021-a7ee-f405876c61ef service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] No waiting events found dispatching network-vif-plugged-c68a76ac-018e-4dff-b242-0381fbdcd6db {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:34:55 user nova-compute[75342]: WARNING nova.compute.manager [req-e0f2b61f-ed58-4f87-9d6d-4dbfa954d795 req-6cb5302b-a0e5-4021-a7ee-f405876c61ef service nova] [instance: 69f7b2a8-ab8e-451b-93ac-0e4ec3112465] Received unexpected event network-vif-plugged-c68a76ac-018e-4dff-b242-0381fbdcd6db for instance with vm_state deleted and task_state None.
Nov 16 18:34:59 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:34:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:35:01 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:04 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:35:05 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:35:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=25.044017791748047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:35:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:35:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:35:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:35:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:35:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:35:05 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:35:05 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:35:05 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:35:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:35:07 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:35:08 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:35:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:35:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:35:10 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:35:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:35:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:35:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:35:10 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:35:10 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:35:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:35:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:35:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:35:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:35:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:35:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:35:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:35:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:35:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:35:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:35:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:35:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:35:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:35:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:35:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Verify base images {{(pid=75342) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Image id ec01624a-c6f0-4ca4-85bf-7b8cba4d816a yields fingerprint e03e7c728286df063197546fbdeb9bb40f5ba449 {{(pid=75342) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] image ec01624a-c6f0-4ca4-85bf-7b8cba4d816a at (/opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449): checking
Nov 16 18:35:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] image ec01624a-c6f0-4ca4-85bf-7b8cba4d816a at (/opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449): image is in use {{(pid=75342) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75342) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] 4981e23c-e326-47ae-bd05-3d31ec08a9a9 is a valid instance name {{(pid=75342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] 4981e23c-e326-47ae-bd05-3d31ec08a9a9 has a disk file {{(pid=75342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 is backed by e03e7c728286df063197546fbdeb9bb40f5ba449 {{(pid=75342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 16 18:35:26 user nova-compute[75342]: WARNING nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710
Nov 16 18:35:26 user nova-compute[75342]: WARNING nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f
Nov 16 18:35:26 user nova-compute[75342]: WARNING nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616
Nov 16 18:35:26 user nova-compute[75342]: WARNING nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3
Nov 16 18:35:26 user nova-compute[75342]: WARNING nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8
Nov 16 18:35:26 user nova-compute[75342]: WARNING nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d
Nov 16 18:35:26 user nova-compute[75342]: WARNING nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572
Nov 16 18:35:26 user nova-compute[75342]: WARNING nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4
Nov 16 18:35:26 user nova-compute[75342]: WARNING nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Active base files: /opt/stack/data/nova/instances/_base/e03e7c728286df063197546fbdeb9bb40f5ba449
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Removable base files: /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710 /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616 /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3 /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8 /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572 /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4 /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2a9b07e1660ba764e92ec25f619a53505d71b710
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d60a34fa426b463e4124337e802a85037e01838f
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d357b24bf58349ed5b1337ea48ea139e205ad616
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/263b17b98bd93cc7fe90329920b779be92f36ef3
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4ef5df1c273b2ed935710b0f316176453dad41f8
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a0b4604d89ecc241091c24869f62316f1e7e3572
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ebfe353879d51b37a8d73350a7342f173038c0d4
Nov 16 18:35:26 user nova-compute[75342]: INFO nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/88e21542f7e99c14674f9f6757edaa17a3848736
Nov 16 18:35:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Verification complete {{(pid=75342) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Verify swap images {{(pid=75342) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 16 18:35:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.imagecache [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Verify ephemeral images {{(pid=75342) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 16 18:35:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:35:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:35:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:35:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:35:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:35:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:35:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:35:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:35:49 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'flavor' on Instance uuid 4981e23c-e326-47ae-bd05-3d31ec08a9a9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:35:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:35:50 user nova-compute[75342]: INFO nova.compute.manager [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Attaching volume 10f65ff6-b9ed-43c6-8ae6-a0035f32875a to /dev/vdb
Nov 16 18:35:50 user nova-compute[75342]: DEBUG os_brick.utils [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d77c6c2-4487-48c4-bc9c-1da06c42ff68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9920de-ae01-4d89-9103-23854f09ab29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1344ce-9cf6-4e47-aa7e-d12160e5dfee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[367d9bd4-f195-45bd-bc0e-3d92f563d541]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:35:50 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:35:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba862ea2-e5e1-4b85-8251-bc0a9e9dbc09]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG os_brick.utils [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:35:50 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating existing volume attachment record: 07b678fc-f318-4144-9a31-52f9d42e5f9e {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ydiKqWfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:35:54 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:35:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:35:54 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:35:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:35:54 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d89acf-c66c-4602-8965-8ed8d27ab55b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:35:54 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30a6a2a-feb1-47e8-8d94-6b21833c9458]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a] added
Nov 16 18:35:54 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ac5f74-362d-48fb-932a-cbb4f2c8decc]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b06b06-4def-44d6-bf1e-60bed59dcee2]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:35:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ydiKqWfA {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ydiKqWfA" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa22686-57d9-4ebb-ae0b-805231e9a917]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ydiKqWfA'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b981923-5f09-448a-92a1-ae1b1285723a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba70db53-2438-47dc-a15a-5b4ad30034c8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:35:55 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:35:55 user nova-compute[75342]:  {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:35:55 user nova-compute[75342]: WARNING os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 18:35:55 user nova-compute[75342]: 
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe492df-78e8-4f5b-8cf5-dbf4f512f12c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a, portal: 172.16.0.220,3260]
Nov 16 18:35:55 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a, portal: 172.16.0.220,3260] successful.
Nov 16 18:35:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e5ddd5-a86a-40cd-9889-b98615397a74]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf416cc7-1afb-448f-a1e9-9fdd52a96274]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a (non-flash)
Nov 16 18:35:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a (non-flash)
Nov 16 18:35:55 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[19222479-ad63-434e-8976-a87c8848b8ff]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:35:55 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:35:56 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:35:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ydiKqWfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:35:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:35:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23963336365353964', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:35:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963336365353964', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:35:56 user nova-compute[75342]: DEBUG nova.objects.instance [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'flavor' on Instance uuid 4981e23c-e326-47ae-bd05-3d31ec08a9a9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:35:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:35:56 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:35:56 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:35:56 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:35:56 user nova-compute[75342]:   <serial>10f65ff6-b9ed-43c6-8ae6-a0035f32875a</serial>
Nov 16 18:35:56 user nova-compute[75342]: </disk>
Nov 16 18:35:56 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:35:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:35:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:35:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] No VIF found with MAC fa:16:3e:f1:b0:28, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:35:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-f3437e9c-2907-41f7-9951-d170f59d6bbb tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.698s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:35:58 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:35:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 18:35:58 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] There are 0 instances to clean {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 18:35:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:00 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-2e0ebc74-dc7b-486a-affc-d6160c1aed36 req-d8165c73-84d6-45c2-874e-b6f8ffbb01c1 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-changed-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:36:00 user nova-compute[75342]: DEBUG nova.compute.manager [req-2e0ebc74-dc7b-486a-affc-d6160c1aed36 req-d8165c73-84d6-45c2-874e-b6f8ffbb01c1 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Refreshing instance network info cache due to event network-changed-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:36:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2e0ebc74-dc7b-486a-affc-d6160c1aed36 req-d8165c73-84d6-45c2-874e-b6f8ffbb01c1 service nova] Acquiring lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:36:00 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2e0ebc74-dc7b-486a-affc-d6160c1aed36 req-d8165c73-84d6-45c2-874e-b6f8ffbb01c1 service nova] Acquired lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:36:00 user nova-compute[75342]: DEBUG nova.network.neutron [req-2e0ebc74-dc7b-486a-affc-d6160c1aed36 req-d8165c73-84d6-45c2-874e-b6f8ffbb01c1 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Refreshing network info cache for port 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:36:00 user nova-compute[75342]: DEBUG nova.network.neutron [req-2e0ebc74-dc7b-486a-affc-d6160c1aed36 req-d8165c73-84d6-45c2-874e-b6f8ffbb01c1 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updated VIF entry in instance network info cache for port 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:36:00 user nova-compute[75342]: DEBUG nova.network.neutron [req-2e0ebc74-dc7b-486a-affc-d6160c1aed36 req-d8165c73-84d6-45c2-874e-b6f8ffbb01c1 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:36:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-2e0ebc74-dc7b-486a-affc-d6160c1aed36 req-d8165c73-84d6-45c2-874e-b6f8ffbb01c1 service nova] Releasing lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:36:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-ed00120f-dd2f-4d14-8bf0-2bda8290dd2f req-2f6c0a76-6c02-419b-91c2-5aa88df99cf9 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-changed-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:36:02 user nova-compute[75342]: DEBUG nova.compute.manager [req-ed00120f-dd2f-4d14-8bf0-2bda8290dd2f req-2f6c0a76-6c02-419b-91c2-5aa88df99cf9 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Refreshing instance network info cache due to event network-changed-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:36:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ed00120f-dd2f-4d14-8bf0-2bda8290dd2f req-2f6c0a76-6c02-419b-91c2-5aa88df99cf9 service nova] Acquiring lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:36:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ed00120f-dd2f-4d14-8bf0-2bda8290dd2f req-2f6c0a76-6c02-419b-91c2-5aa88df99cf9 service nova] Acquired lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:36:02 user nova-compute[75342]: DEBUG nova.network.neutron [req-ed00120f-dd2f-4d14-8bf0-2bda8290dd2f req-2f6c0a76-6c02-419b-91c2-5aa88df99cf9 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Refreshing network info cache for port 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:36:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:03 user nova-compute[75342]: DEBUG nova.network.neutron [req-ed00120f-dd2f-4d14-8bf0-2bda8290dd2f req-2f6c0a76-6c02-419b-91c2-5aa88df99cf9 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updated VIF entry in instance network info cache for port 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:36:03 user nova-compute[75342]: DEBUG nova.network.neutron [req-ed00120f-dd2f-4d14-8bf0-2bda8290dd2f req-2f6c0a76-6c02-419b-91c2-5aa88df99cf9 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:36:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-ed00120f-dd2f-4d14-8bf0-2bda8290dd2f req-2f6c0a76-6c02-419b-91c2-5aa88df99cf9 service nova] Releasing lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:36:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:36:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:36:03 user nova-compute[75342]: INFO nova.compute.manager [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Rebooting instance
Nov 16 18:36:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:36:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquired lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:36:03 user nova-compute[75342]: DEBUG nova.network.neutron [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:36:04 user nova-compute[75342]: DEBUG nova.network.neutron [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:36:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Releasing lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:36:04 user nova-compute[75342]: DEBUG nova.compute.manager [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:36:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-94dcc414-34e7-454e-aff9-f2593837609a req-f12fce36-5dcb-4468-bdf4-b2c9dbd8bb68 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-vif-unplugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-94dcc414-34e7-454e-aff9-f2593837609a req-f12fce36-5dcb-4468-bdf4-b2c9dbd8bb68 service nova] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-94dcc414-34e7-454e-aff9-f2593837609a req-f12fce36-5dcb-4468-bdf4-b2c9dbd8bb68 service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-94dcc414-34e7-454e-aff9-f2593837609a req-f12fce36-5dcb-4468-bdf4-b2c9dbd8bb68 service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG nova.compute.manager [req-94dcc414-34e7-454e-aff9-f2593837609a req-f12fce36-5dcb-4468-bdf4-b2c9dbd8bb68 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] No waiting events found dispatching network-vif-unplugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:36:06 user nova-compute[75342]: WARNING nova.compute.manager [req-94dcc414-34e7-454e-aff9-f2593837609a req-f12fce36-5dcb-4468-bdf4-b2c9dbd8bb68 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received unexpected event network-vif-unplugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 for instance with vm_state active and task_state reboot_started.
Nov 16 18:36:06 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:36:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:36:07 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:36:07 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.041805267333984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:36:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Instance shutdown successfully.
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing inventories for resource provider fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating ProviderTree inventory for provider fdd6b940-75a0-4315-8416-79157aaeea59 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing aggregate associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, aggregates: None {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing trait associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, traits: COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:36:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] No waiting events found dispatching network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:36:08 user nova-compute[75342]: WARNING nova.compute.manager [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received unexpected event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 for instance with vm_state active and task_state reboot_started.
Nov 16 18:36:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:36:08 user nova-compute[75342]: DEBUG nova.compute.manager [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] No waiting events found dispatching network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:36:08 user nova-compute[75342]: WARNING nova.compute.manager [req-e7a1a82d-d1a1-45fa-81b1-ff7f0eece5e8 req-132dad5c-869f-43d3-a828-56dd0e06f62a service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received unexpected event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 for instance with vm_state active and task_state reboot_started.
Nov 16 18:36:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Instance running successfully.
Nov 16 18:36:10 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Instance soft rebooted successfully.
Nov 16 18:36:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:36:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-a98f0adf-cf60-4f79-bd88-56491bee82c1 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.149s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:36:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-0a8e4b66-d372-4fa7-bbbb-4afbaea675cf req-db297984-e91b-4c71-bb2b-3af8138450be service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:36:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0a8e4b66-d372-4fa7-bbbb-4afbaea675cf req-db297984-e91b-4c71-bb2b-3af8138450be service nova] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:36:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0a8e4b66-d372-4fa7-bbbb-4afbaea675cf req-db297984-e91b-4c71-bb2b-3af8138450be service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:36:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-0a8e4b66-d372-4fa7-bbbb-4afbaea675cf req-db297984-e91b-4c71-bb2b-3af8138450be service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:36:10 user nova-compute[75342]: DEBUG nova.compute.manager [req-0a8e4b66-d372-4fa7-bbbb-4afbaea675cf req-db297984-e91b-4c71-bb2b-3af8138450be service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] No waiting events found dispatching network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:36:10 user nova-compute[75342]: WARNING nova.compute.manager [req-0a8e4b66-d372-4fa7-bbbb-4afbaea675cf req-db297984-e91b-4c71-bb2b-3af8138450be service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received unexpected event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 for instance with vm_state active and task_state None.
Nov 16 18:36:12 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:12 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:36:12 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:36:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:36:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:36:12 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:36:12 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 4981e23c-e326-47ae-bd05-3d31ec08a9a9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:36:12 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:36:12 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:36:12 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:36:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:21 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:21 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:36:24 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:36:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 4981e23c-e326-47ae-bd05-3d31ec08a9a9 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:36:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:36:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:36:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:36:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:36:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:36:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:01 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:37:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:37:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:37:06 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:37:06 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:37:07 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:37:08 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:37:08 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:37:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:37:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:37:08 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:37:08 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:37:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:37:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:37:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:37:08 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:37:08 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 18:37:09 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:37:09 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:37:09 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=25.040328979492188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:37:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:37:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:37:09 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:37:09 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:37:09 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:37:09 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:37:09 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:37:09 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:37:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:37:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:37:10 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:37:11 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 4981e23c-e326-47ae-bd05-3d31ec08a9a9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:37:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:37:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:37:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:37:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:55 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-87d11de9-b7be-4a00-b3ba-d157d1311803 req-8ce67b1f-816f-4d25-9ed5-936ede754c76 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-changed-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:37:55 user nova-compute[75342]: DEBUG nova.compute.manager [req-87d11de9-b7be-4a00-b3ba-d157d1311803 req-8ce67b1f-816f-4d25-9ed5-936ede754c76 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Refreshing instance network info cache due to event network-changed-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:37:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-87d11de9-b7be-4a00-b3ba-d157d1311803 req-8ce67b1f-816f-4d25-9ed5-936ede754c76 service nova] Acquiring lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:37:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-87d11de9-b7be-4a00-b3ba-d157d1311803 req-8ce67b1f-816f-4d25-9ed5-936ede754c76 service nova] Acquired lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:37:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-87d11de9-b7be-4a00-b3ba-d157d1311803 req-8ce67b1f-816f-4d25-9ed5-936ede754c76 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Refreshing network info cache for port 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:37:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-87d11de9-b7be-4a00-b3ba-d157d1311803 req-8ce67b1f-816f-4d25-9ed5-936ede754c76 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updated VIF entry in instance network info cache for port 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:37:55 user nova-compute[75342]: DEBUG nova.network.neutron [req-87d11de9-b7be-4a00-b3ba-d157d1311803 req-8ce67b1f-816f-4d25-9ed5-936ede754c76 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:37:55 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-87d11de9-b7be-4a00-b3ba-d157d1311803 req-8ce67b1f-816f-4d25-9ed5-936ede754c76 service nova] Releasing lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:37:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:37:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:37:56 user nova-compute[75342]: INFO nova.compute.manager [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Detaching volume 10f65ff6-b9ed-43c6-8ae6-a0035f32875a
Nov 16 18:37:56 user nova-compute[75342]: INFO nova.virt.block_device [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Attempting to driver detach volume 10f65ff6-b9ed-43c6-8ae6-a0035f32875a from mountpoint /dev/vdb
Nov 16 18:37:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Attempting to detach device vdb from instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:37:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:37:56 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:37:56 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:37:56 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:37:56 user nova-compute[75342]:   <serial>10f65ff6-b9ed-43c6-8ae6-a0035f32875a</serial>
Nov 16 18:37:56 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:37:56 user nova-compute[75342]: </disk>
Nov 16 18:37:56 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:37:56 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Successfully detached device vdb from instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 from the persistent domain config.
Nov 16 18:37:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:37:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:37:56 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:37:56 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:37:56 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:37:56 user nova-compute[75342]:   <serial>10f65ff6-b9ed-43c6-8ae6-a0035f32875a</serial>
Nov 16 18:37:56 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:37:56 user nova-compute[75342]: </disk>
Nov 16 18:37:56 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:37:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:37:57 user nova-compute[75342]: DEBUG nova.compute.manager [req-77f55b20-798c-463d-8e2e-36ac4f802775 req-9896498f-fbf4-468f-abdc-c720e2b9bc5e service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-changed-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:37:57 user nova-compute[75342]: DEBUG nova.compute.manager [req-77f55b20-798c-463d-8e2e-36ac4f802775 req-9896498f-fbf4-468f-abdc-c720e2b9bc5e service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Refreshing instance network info cache due to event network-changed-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:37:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-77f55b20-798c-463d-8e2e-36ac4f802775 req-9896498f-fbf4-468f-abdc-c720e2b9bc5e service nova] Acquiring lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:37:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-77f55b20-798c-463d-8e2e-36ac4f802775 req-9896498f-fbf4-468f-abdc-c720e2b9bc5e service nova] Acquired lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:37:57 user nova-compute[75342]: DEBUG nova.network.neutron [req-77f55b20-798c-463d-8e2e-36ac4f802775 req-9896498f-fbf4-468f-abdc-c720e2b9bc5e service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Refreshing network info cache for port 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:37:57 user nova-compute[75342]: DEBUG nova.network.neutron [req-77f55b20-798c-463d-8e2e-36ac4f802775 req-9896498f-fbf4-468f-abdc-c720e2b9bc5e service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updated VIF entry in instance network info cache for port 3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:37:57 user nova-compute[75342]: DEBUG nova.network.neutron [req-77f55b20-798c-463d-8e2e-36ac4f802775 req-9896498f-fbf4-468f-abdc-c720e2b9bc5e service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:37:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-77f55b20-798c-463d-8e2e-36ac4f802775 req-9896498f-fbf4-468f-abdc-c720e2b9bc5e service nova] Releasing lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:37:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:37:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:03 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:38:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:38:06 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:38:08 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:38:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:38:09 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:10 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:38:10 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:38:10 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=25.039600372314453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:38:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:38:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:38:10 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:38:10 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:38:10 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:38:10 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:38:10 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:38:10 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:38:10 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:38:12 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 4981e23c-e326-47ae-bd05-3d31ec08a9a9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [{"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-4981e23c-e326-47ae-bd05-3d31ec08a9a9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:38:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:38:16 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 is timed out.
Nov 16 18:38:16 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Successfully detached device vdb from instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9 from the live domain config.
Nov 16 18:38:16 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ydiKqWfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:38:16 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9739fc-ea67-44ff-93bf-fa3eda519803]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:38:16 user nova-compute[75342]: No targets found.
Nov 16 18:38:16 user nova-compute[75342]: iSNS:
Nov 16 18:38:16 user nova-compute[75342]: No targets found.
Nov 16 18:38:16 user nova-compute[75342]: STATIC:
Nov 16 18:38:16 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a
Nov 16 18:38:16 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:38:16 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:38:16 user nova-compute[75342]: FIRMWARE:
Nov 16 18:38:16 user nova-compute[75342]: No targets found.
Nov 16 18:38:16 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:38:16 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:38:16 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9fed16-1f4b-4e9a-b942-a0b0f935312f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf575e30-cf1f-4b2c-93e1-70bf4fc57cef]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a (non-flash)
Nov 16 18:38:16 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a (non-flash)
Nov 16 18:38:16 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6d13d5120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1520f4f7-739a-4b3f-acd6-d9f6032ecb37]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9553cad-0f47-46ad-abe9-037b159cae1f]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7044fa62-3674-4a55-9bab-c3a591a41ae0]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8c8ae0-89b5-40ec-97e2-3e1fb1a377f7]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:38:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[24225f57-8869-4ba1-9bb4-0bec46d4344b]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5fb91a-9879-4a8a-9cb6-c6afb08ce1bf]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a, portal: 172.16.0.220,3260]
Nov 16 18:38:17 user nova-compute[75342]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a, portal: 172.16.0.220,3260] successful.
Nov 16 18:38:17 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10f65ff6-b9ed-43c6-8ae6-a0035f32875a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f441ae-2446-4e35-8e3e-83afeb9cece1]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] <== disconnect_volume: return (302ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:38:17 user nova-compute[75342]: DEBUG nova.objects.instance [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'flavor' on Instance uuid 4981e23c-e326-47ae-bd05-3d31ec08a9a9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:38:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-dd2cd508-2fed-41f6-8d1e-b9ec84c08d61 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.818s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:38:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:24 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:38:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:38:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:38:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5006 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:38:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:38:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:38:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:38:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:38:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:38:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:38:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:38:48 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:38:48 user nova-compute[75342]: INFO nova.compute.manager [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Terminating instance
Nov 16 18:38:48 user nova-compute[75342]: DEBUG nova.compute.manager [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:38:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:48 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-14fb4ea6-b492-4e0f-9c8d-36bdc52a76b9 req-50c21873-1923-4562-9da7-d818b175da15 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-vif-unplugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-14fb4ea6-b492-4e0f-9c8d-36bdc52a76b9 req-50c21873-1923-4562-9da7-d818b175da15 service nova] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-14fb4ea6-b492-4e0f-9c8d-36bdc52a76b9 req-50c21873-1923-4562-9da7-d818b175da15 service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-14fb4ea6-b492-4e0f-9c8d-36bdc52a76b9 req-50c21873-1923-4562-9da7-d818b175da15 service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-14fb4ea6-b492-4e0f-9c8d-36bdc52a76b9 req-50c21873-1923-4562-9da7-d818b175da15 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] No waiting events found dispatching network-vif-unplugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG nova.compute.manager [req-14fb4ea6-b492-4e0f-9c8d-36bdc52a76b9 req-50c21873-1923-4562-9da7-d818b175da15 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-vif-unplugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:49 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Instance destroyed successfully.
Nov 16 18:38:49 user nova-compute[75342]: DEBUG nova.objects.instance [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lazy-loading 'resources' on Instance uuid 4981e23c-e326-47ae-bd05-3d31ec08a9a9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-877683055',display_name='tempest-TestMinimumBasicScenario-server-877683055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-877683055',id=52,image_ref='ec01624a-c6f0-4ca4-85bf-7b8cba4d816a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJa53iD4kfvIoFu67XM8tLrRfbU0tUanMml9sC2WGp6pZYnDK/1HyMx7P5VGay49uAbU0PwsilG7X4p+os3nvRAkOtiuRAEaMHlZI1RV0ZBAcT6oWKTkEmFMoPKokk2Cw==',key_name='tempest-TestMinimumBasicScenario-1873989759',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='556d660660644cceb015589ace168ca5',ramdisk_id='',reservation_id='r-h4om7dkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ec01624a-c6f0-4ca4-85bf-7b8cba4d816a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2125212492',owner_user_name='tempest-TestMinimumBasicScenario-2125212492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:36:11Z,user_data=None,user_id='752db55aae8e42508a2b5df43e7019f0',uuid=4981e23c-e326-47ae-bd05-3d31ec08a9a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converting VIF {"id": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "address": "fa:16:3e:f1:b0:28", "network": {"id": "28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-96483613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "556d660660644cceb015589ace168ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0d0abd-f5", "ovs_interfaceid": "3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b0:28,bridge_name='br-int',has_traffic_filtering=True,id=3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0d0abd-f5') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG os_vif [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b0:28,bridge_name='br-int',has_traffic_filtering=True,id=3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0d0abd-f5') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e0d0abd-f5, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53752822-2a57-4a72-96c4-c6ed0341aa58) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:38:49 user nova-compute[75342]: INFO os_vif [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b0:28,bridge_name='br-int',has_traffic_filtering=True,id=3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6,network=Network(28aa8dc8-e4f0-4c7c-877c-0d4df9004b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0d0abd-f5')
Nov 16 18:38:49 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Deleting instance files /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9_del
Nov 16 18:38:49 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Deletion of /opt/stack/data/nova/instances/4981e23c-e326-47ae-bd05-3d31ec08a9a9_del complete
Nov 16 18:38:49 user nova-compute[75342]: INFO nova.compute.manager [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 18:38:49 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:38:49 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:38:50 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:50 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:38:50 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Took 0.53 seconds to deallocate network for instance.
Nov 16 18:38:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:38:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:38:50 user nova-compute[75342]: DEBUG nova.compute.manager [req-1305e5e6-2439-439b-aacb-9761a882d6a1 req-17525521-41eb-4838-9522-f08c33660d3d service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-vif-deleted-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:38:50 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:38:50 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:38:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:38:50 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Deleted allocations for instance 4981e23c-e326-47ae-bd05-3d31ec08a9a9
Nov 16 18:38:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bdcf4c73-3648-42c3-afaa-127c472055f0 tempest-TestMinimumBasicScenario-2125212492 tempest-TestMinimumBasicScenario-2125212492-project-member] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.705s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:38:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-cf43cd8d-0a5a-4859-b774-64204824ceda req-f765c1e8-0ff2-436c-90f1-debbad562d97 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:38:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cf43cd8d-0a5a-4859-b774-64204824ceda req-f765c1e8-0ff2-436c-90f1-debbad562d97 service nova] Acquiring lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:38:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cf43cd8d-0a5a-4859-b774-64204824ceda req-f765c1e8-0ff2-436c-90f1-debbad562d97 service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:38:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-cf43cd8d-0a5a-4859-b774-64204824ceda req-f765c1e8-0ff2-436c-90f1-debbad562d97 service nova] Lock "4981e23c-e326-47ae-bd05-3d31ec08a9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:38:51 user nova-compute[75342]: DEBUG nova.compute.manager [req-cf43cd8d-0a5a-4859-b774-64204824ceda req-f765c1e8-0ff2-436c-90f1-debbad562d97 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] No waiting events found dispatching network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:38:51 user nova-compute[75342]: WARNING nova.compute.manager [req-cf43cd8d-0a5a-4859-b774-64204824ceda req-f765c1e8-0ff2-436c-90f1-debbad562d97 service nova] [instance: 4981e23c-e326-47ae-bd05-3d31ec08a9a9] Received unexpected event network-vif-plugged-3e0d0abd-f5ba-4a19-8db0-361c3fc7bfe6 for instance with vm_state deleted and task_state None.
Nov 16 18:38:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:38:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:39:04 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:39:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:39:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:39:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:39:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:39:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:07 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:39:08 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:39:08 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:39:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:39:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:10 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:39:11 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:39:11 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:39:11 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=9150MB free_disk=25.06690216064453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:39:11 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:39:13 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:39:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:16 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:39:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:39:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:39:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 18:39:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:39:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:39:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:39:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:39:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:39:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:39:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:39:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:40:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:05 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:40:08 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:40:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:40:10 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:40:10 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:40:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:40:11 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:40:13 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:40:13 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:40:13 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=9253MB free_disk=25.104354858398438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:40:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:40:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:15 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:40:17 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:40:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:40:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:40:17 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 18:40:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:25 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:40:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:33 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:36 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:41 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:43 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Starting instance... {{(pid=75342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 18:40:50 user nova-compute[75342]: INFO nova.compute.claims [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Claim successful on node user
Nov 16 18:40:50 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Start building networks asynchronously for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Allocating IP information in the background. {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] allocate_for_instance() {{(pid=75342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 18:40:50 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 18:40:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Start building block device mappings for instance. {{(pid=75342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG nova.policy [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10ec34ffcd99495cbc04a745341d9b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c66fde6c404eb8e651a1fab2a3c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75342) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Start spawning the instance on the hypervisor. {{(pid=75342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Creating instance directory {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 18:40:50 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Creating image(s)
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "/opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "/opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "/opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:40:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.190s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk 1073741824 {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d,backing_fmt=raw /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk 1073741824" returned: 0 in 0.054s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c290882a0e8515a8a2c8dec76b1cf75eb7aeb7d --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Checking if we can resize image /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk. size=1073741824 {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Successfully created port: 6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG nova.virt.disk.api [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Cannot resize image /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk to a smaller size. {{(pid=75342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Created local disks {{(pid=75342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Ensure instance console log exists: /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/console.log {{(pid=75342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:40:51 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Successfully updated port: 6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquired lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Building network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-c8f4f949-1f6c-4cab-88f4-1430ee373ada req-efaf5575-2ec9-48c4-ad56-3ef9f1883852 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Received event network-changed-6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.compute.manager [req-c8f4f949-1f6c-4cab-88f4-1430ee373ada req-efaf5575-2ec9-48c4-ad56-3ef9f1883852 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Refreshing instance network info cache due to event network-changed-6b9deb14-333c-4a73-a867-4ebf056c7ea2. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c8f4f949-1f6c-4cab-88f4-1430ee373ada req-efaf5575-2ec9-48c4-ad56-3ef9f1883852 service nova] Acquiring lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Instance cache missing network info. {{(pid=75342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.network.neutron [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating instance_info_cache with network_info: [{"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Releasing lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Instance network_info: |[{"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c8f4f949-1f6c-4cab-88f4-1430ee373ada req-efaf5575-2ec9-48c4-ad56-3ef9f1883852 service nova] Acquired lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.network.neutron [req-c8f4f949-1f6c-4cab-88f4-1430ee373ada req-efaf5575-2ec9-48c4-ad56-3ef9f1883852 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Refreshing network info cache for port 6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Start _get_guest_xml network_info=[{"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'c3510820-8b2c-4ce9-a892-c10a662aeed6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 18:40:52 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:40:52 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] CPU controller missing on host. {{(pid=75342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.host [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] CPU controller found on host. {{(pid=75342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T17:55:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T17:55:55Z,direct_url=<?>,disk_format='qcow2',id=c3510820-8b2c-4ce9-a892-c10a662aeed6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cde44693ac4d4e6aa4874162714c9ba9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T17:55:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Flavor limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Image limits 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Flavor pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Image pref 0:0:0 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Got 1 possible topologies {{(pid=75342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.hardware [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:40:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2025334440',display_name='tempest-SnapshotDataIntegrityTests-server-2025334440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2025334440',id=53,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLRMr7QYpzuNgG+9cbP0qAol9o2upv4uj52vjCWq8dtzwkfphF06f02iGfONqbXj8wuVlTkiZ71Eupcn69I+y4lSplDkiekvPe/NpU0A9Wgr08BjohO29BUGLKv/8ZI8g==',key_name='tempest-keypair-273943359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08a6c66fde6c404eb8e651a1fab2a3c8',ramdisk_id='',reservation_id='r-bi3vwbgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1869800382',owner_user_name='tempest-SnapshotDataIntegrityTests-1869800382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10ec34ffcd99495cbc04a745341d9b23',uuid=631dbfac-d5f2-438d-94e0-c8980f6a13b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Converting VIF {"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f1:bf,bridge_name='br-int',has_traffic_filtering=True,id=6b9deb14-333c-4a73-a867-4ebf056c7ea2,network=Network(61ed1770-dcc5-46d0-87fa-37a7ab859b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9deb14-33') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.objects.instance [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'pci_devices' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 18:40:52 user nova-compute[75342]:   <uuid>631dbfac-d5f2-438d-94e0-c8980f6a13b9</uuid>
Nov 16 18:40:52 user nova-compute[75342]:   <name>instance-00000035</name>
Nov 16 18:40:52 user nova-compute[75342]:   <memory>524288</memory>
Nov 16 18:40:52 user nova-compute[75342]:   <vcpu>1</vcpu>
Nov 16 18:40:52 user nova-compute[75342]:   <metadata>
Nov 16 18:40:52 user nova-compute[75342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 18:40:52 user nova-compute[75342]:       <nova:package version="0.0.0"/>
Nov 16 18:40:52 user nova-compute[75342]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2025334440</nova:name>
Nov 16 18:40:52 user nova-compute[75342]:       <nova:creationTime>2023-11-16 18:40:52</nova:creationTime>
Nov 16 18:40:52 user nova-compute[75342]:       <nova:flavor name="m1.tiny">
Nov 16 18:40:52 user nova-compute[75342]:         <nova:memory>512</nova:memory>
Nov 16 18:40:52 user nova-compute[75342]:         <nova:disk>1</nova:disk>
Nov 16 18:40:52 user nova-compute[75342]:         <nova:swap>0</nova:swap>
Nov 16 18:40:52 user nova-compute[75342]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 18:40:52 user nova-compute[75342]:         <nova:vcpus>1</nova:vcpus>
Nov 16 18:40:52 user nova-compute[75342]:       </nova:flavor>
Nov 16 18:40:52 user nova-compute[75342]:       <nova:owner>
Nov 16 18:40:52 user nova-compute[75342]:         <nova:user uuid="10ec34ffcd99495cbc04a745341d9b23">tempest-SnapshotDataIntegrityTests-1869800382-project-member</nova:user>
Nov 16 18:40:52 user nova-compute[75342]:         <nova:project uuid="08a6c66fde6c404eb8e651a1fab2a3c8">tempest-SnapshotDataIntegrityTests-1869800382</nova:project>
Nov 16 18:40:52 user nova-compute[75342]:       </nova:owner>
Nov 16 18:40:52 user nova-compute[75342]:       <nova:root type="image" uuid="c3510820-8b2c-4ce9-a892-c10a662aeed6"/>
Nov 16 18:40:52 user nova-compute[75342]:       <nova:ports>
Nov 16 18:40:52 user nova-compute[75342]:         <nova:port uuid="6b9deb14-333c-4a73-a867-4ebf056c7ea2">
Nov 16 18:40:52 user nova-compute[75342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 18:40:52 user nova-compute[75342]:         </nova:port>
Nov 16 18:40:52 user nova-compute[75342]:       </nova:ports>
Nov 16 18:40:52 user nova-compute[75342]:     </nova:instance>
Nov 16 18:40:52 user nova-compute[75342]:   </metadata>
Nov 16 18:40:52 user nova-compute[75342]:   <sysinfo type="smbios">
Nov 16 18:40:52 user nova-compute[75342]:     <system>
Nov 16 18:40:52 user nova-compute[75342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 18:40:52 user nova-compute[75342]:       <entry name="product">OpenStack Nova</entry>
Nov 16 18:40:52 user nova-compute[75342]:       <entry name="version">0.0.0</entry>
Nov 16 18:40:52 user nova-compute[75342]:       <entry name="serial">631dbfac-d5f2-438d-94e0-c8980f6a13b9</entry>
Nov 16 18:40:52 user nova-compute[75342]:       <entry name="uuid">631dbfac-d5f2-438d-94e0-c8980f6a13b9</entry>
Nov 16 18:40:52 user nova-compute[75342]:       <entry name="family">Virtual Machine</entry>
Nov 16 18:40:52 user nova-compute[75342]:     </system>
Nov 16 18:40:52 user nova-compute[75342]:   </sysinfo>
Nov 16 18:40:52 user nova-compute[75342]:   <os>
Nov 16 18:40:52 user nova-compute[75342]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 18:40:52 user nova-compute[75342]:     <boot dev="hd"/>
Nov 16 18:40:52 user nova-compute[75342]:     <smbios mode="sysinfo"/>
Nov 16 18:40:52 user nova-compute[75342]:   </os>
Nov 16 18:40:52 user nova-compute[75342]:   <features>
Nov 16 18:40:52 user nova-compute[75342]:     <acpi/>
Nov 16 18:40:52 user nova-compute[75342]:     <apic/>
Nov 16 18:40:52 user nova-compute[75342]:     <vmcoreinfo/>
Nov 16 18:40:52 user nova-compute[75342]:   </features>
Nov 16 18:40:52 user nova-compute[75342]:   <clock offset="utc">
Nov 16 18:40:52 user nova-compute[75342]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 18:40:52 user nova-compute[75342]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 18:40:52 user nova-compute[75342]:     <timer name="hpet" present="no"/>
Nov 16 18:40:52 user nova-compute[75342]:   </clock>
Nov 16 18:40:52 user nova-compute[75342]:   <cpu mode="custom" match="exact">
Nov 16 18:40:52 user nova-compute[75342]:     <model>Nehalem</model>
Nov 16 18:40:52 user nova-compute[75342]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 18:40:52 user nova-compute[75342]:   </cpu>
Nov 16 18:40:52 user nova-compute[75342]:   <devices>
Nov 16 18:40:52 user nova-compute[75342]:     <disk type="file" device="disk">
Nov 16 18:40:52 user nova-compute[75342]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 18:40:52 user nova-compute[75342]:       <source file="/opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk"/>
Nov 16 18:40:52 user nova-compute[75342]:       <target dev="vda" bus="virtio"/>
Nov 16 18:40:52 user nova-compute[75342]:     </disk>
Nov 16 18:40:52 user nova-compute[75342]:     <interface type="ethernet">
Nov 16 18:40:52 user nova-compute[75342]:       <mac address="fa:16:3e:b8:f1:bf"/>
Nov 16 18:40:52 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:40:52 user nova-compute[75342]:       <mtu size="1442"/>
Nov 16 18:40:52 user nova-compute[75342]:       <target dev="tap6b9deb14-33"/>
Nov 16 18:40:52 user nova-compute[75342]:     </interface>
Nov 16 18:40:52 user nova-compute[75342]:     <serial type="pty">
Nov 16 18:40:52 user nova-compute[75342]:       <log file="/opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/console.log" append="off"/>
Nov 16 18:40:52 user nova-compute[75342]:     </serial>
Nov 16 18:40:52 user nova-compute[75342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 18:40:52 user nova-compute[75342]:     <video>
Nov 16 18:40:52 user nova-compute[75342]:       <model type="virtio"/>
Nov 16 18:40:52 user nova-compute[75342]:     </video>
Nov 16 18:40:52 user nova-compute[75342]:     <rng model="virtio">
Nov 16 18:40:52 user nova-compute[75342]:       <backend model="random">/dev/urandom</backend>
Nov 16 18:40:52 user nova-compute[75342]:     </rng>
Nov 16 18:40:52 user nova-compute[75342]:     <controller type="usb" index="0" model="none"/>
Nov 16 18:40:52 user nova-compute[75342]:     <memballoon model="virtio">
Nov 16 18:40:52 user nova-compute[75342]:       <stats period="10"/>
Nov 16 18:40:52 user nova-compute[75342]:     </memballoon>
Nov 16 18:40:52 user nova-compute[75342]:   </devices>
Nov 16 18:40:52 user nova-compute[75342]: </domain>
Nov 16 18:40:52 user nova-compute[75342]:  {{(pid=75342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:40:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2025334440',display_name='tempest-SnapshotDataIntegrityTests-server-2025334440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2025334440',id=53,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLRMr7QYpzuNgG+9cbP0qAol9o2upv4uj52vjCWq8dtzwkfphF06f02iGfONqbXj8wuVlTkiZ71Eupcn69I+y4lSplDkiekvPe/NpU0A9Wgr08BjohO29BUGLKv/8ZI8g==',key_name='tempest-keypair-273943359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08a6c66fde6c404eb8e651a1fab2a3c8',ramdisk_id='',reservation_id='r-bi3vwbgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1869800382',owner_user_name='tempest-SnapshotDataIntegrityTests-1869800382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T18:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10ec34ffcd99495cbc04a745341d9b23',uuid=631dbfac-d5f2-438d-94e0-c8980f6a13b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Converting VIF {"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f1:bf,bridge_name='br-int',has_traffic_filtering=True,id=6b9deb14-333c-4a73-a867-4ebf056c7ea2,network=Network(61ed1770-dcc5-46d0-87fa-37a7ab859b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9deb14-33') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG os_vif [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f1:bf,bridge_name='br-int',has_traffic_filtering=True,id=6b9deb14-333c-4a73-a867-4ebf056c7ea2,network=Network(61ed1770-dcc5-46d0-87fa-37a7ab859b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9deb14-33') {{(pid=75342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7446ff48-cebe-5584-84bd-13449fd43deb', '_type': 'linux-noop'}}, row=False) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b9deb14-33, may_exist=True, interface_attrs={}) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b9deb14-33, col_values=(('qos', UUID('852ec7fe-67c9-46ee-831f-05ba67904a72')),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b9deb14-33, col_values=(('external_ids', {'iface-id': '6b9deb14-333c-4a73-a867-4ebf056c7ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:f1:bf', 'vm-uuid': '631dbfac-d5f2-438d-94e0-c8980f6a13b9'}),), if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:52 user nova-compute[75342]: INFO os_vif [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f1:bf,bridge_name='br-int',has_traffic_filtering=True,id=6b9deb14-333c-4a73-a867-4ebf056c7ea2,network=Network(61ed1770-dcc5-46d0-87fa-37a7ab859b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9deb14-33')
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:40:52 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No VIF found with MAC fa:16:3e:b8:f1:bf, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:40:53 user nova-compute[75342]: DEBUG nova.network.neutron [req-c8f4f949-1f6c-4cab-88f4-1430ee373ada req-efaf5575-2ec9-48c4-ad56-3ef9f1883852 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updated VIF entry in instance network info cache for port 6b9deb14-333c-4a73-a867-4ebf056c7ea2. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:40:53 user nova-compute[75342]: DEBUG nova.network.neutron [req-c8f4f949-1f6c-4cab-88f4-1430ee373ada req-efaf5575-2ec9-48c4-ad56-3ef9f1883852 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating instance_info_cache with network_info: [{"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:40:53 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-c8f4f949-1f6c-4cab-88f4-1430ee373ada req-efaf5575-2ec9-48c4-ad56-3ef9f1883852 service nova] Releasing lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:40:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-15ac4c65-887c-400f-9441-09f7255f8eac req-98de7cc6-ef58-449f-b4f3-8c51b38d0564 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Received event network-vif-plugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:40:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-15ac4c65-887c-400f-9441-09f7255f8eac req-98de7cc6-ef58-449f-b4f3-8c51b38d0564 service nova] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:40:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-15ac4c65-887c-400f-9441-09f7255f8eac req-98de7cc6-ef58-449f-b4f3-8c51b38d0564 service nova] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:40:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-15ac4c65-887c-400f-9441-09f7255f8eac req-98de7cc6-ef58-449f-b4f3-8c51b38d0564 service nova] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:40:54 user nova-compute[75342]: DEBUG nova.compute.manager [req-15ac4c65-887c-400f-9441-09f7255f8eac req-98de7cc6-ef58-449f-b4f3-8c51b38d0564 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] No waiting events found dispatching network-vif-plugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:40:54 user nova-compute[75342]: WARNING nova.compute.manager [req-15ac4c65-887c-400f-9441-09f7255f8eac req-98de7cc6-ef58-449f-b4f3-8c51b38d0564 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Received unexpected event network-vif-plugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 for instance with vm_state building and task_state spawning.
Nov 16 18:40:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-5a43b42c-e9a6-4971-8432-100ad3b5b6a7 req-0083e019-4065-4e95-8222-c7f5dcb41af3 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Received event network-vif-plugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5a43b42c-e9a6-4971-8432-100ad3b5b6a7 req-0083e019-4065-4e95-8222-c7f5dcb41af3 service nova] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5a43b42c-e9a6-4971-8432-100ad3b5b6a7 req-0083e019-4065-4e95-8222-c7f5dcb41af3 service nova] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-5a43b42c-e9a6-4971-8432-100ad3b5b6a7 req-0083e019-4065-4e95-8222-c7f5dcb41af3 service nova] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.compute.manager [req-5a43b42c-e9a6-4971-8432-100ad3b5b6a7 req-0083e019-4065-4e95-8222-c7f5dcb41af3 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] No waiting events found dispatching network-vif-plugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:40:56 user nova-compute[75342]: WARNING nova.compute.manager [req-5a43b42c-e9a6-4971-8432-100ad3b5b6a7 req-0083e019-4065-4e95-8222-c7f5dcb41af3 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Received unexpected event network-vif-plugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 for instance with vm_state building and task_state spawning.
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Instance event wait completed in 0 seconds for  {{(pid=75342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Guest created on hypervisor {{(pid=75342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 18:40:56 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Instance spawned successfully.
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Found default for hw_cdrom_bus of ide {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Found default for hw_disk_bus of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Found default for hw_input_bus of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Found default for hw_pointer_model of None {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Found default for hw_video_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Found default for hw_vif_model of virtio {{(pid=75342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 18:40:56 user nova-compute[75342]: INFO nova.compute.manager [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 16 18:40:56 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Checking state {{(pid=75342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 18:40:56 user nova-compute[75342]: INFO nova.compute.manager [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Took 6.45 seconds to build instance.
Nov 16 18:40:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c362e51b-c674-4c43-ba46-d71ab601dddb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.557s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:40:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:40:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:06 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:07 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 18:41:07 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] There are 0 instances to clean {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 18:41:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:41:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:10 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:10 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:41:12 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:13 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:13 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:13 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 18:41:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:15 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:41:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:41:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:41:15 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:41:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:41:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:41:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:41:15 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:41:16 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:41:16 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8915MB free_disk=25.06255340576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing inventories for resource provider fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating ProviderTree inventory for provider fdd6b940-75a0-4315-8416-79157aaeea59 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing aggregate associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, aggregates: None {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing trait associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, traits: COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:41:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:41:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:18 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:41:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:41:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:41:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:41:18 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:41:18 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:41:19 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating instance_info_cache with network_info: [{"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:41:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:41:19 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:41:19 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:28 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:41:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:41:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:41:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:41:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:41:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:41:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:41:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:41:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:41:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:41:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:42:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:42:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:08 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:42:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:42:11 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:42:11 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:42:12 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:42:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:42:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:42:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:42:16 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:42:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:42:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:42:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:42:16 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:42:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:42:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:42:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=25.059974670410156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:42:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:42:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:42:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:42:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:42:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:42:17 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:42:17 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:42:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:42:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:42:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:18 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:42:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:42:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:42:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:42:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:42:18 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:42:18 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:42:18 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating instance_info_cache with network_info: [{"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:42:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:42:18 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:42:19 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:42:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:42:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:30 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:42:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:42:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:42:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:42:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:42:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-1b916054-1f5e-4f68-9342-771025c79b9a req-b8fddc41-bb84-4181-ac84-115457ef2720 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Received event network-changed-6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:42:41 user nova-compute[75342]: DEBUG nova.compute.manager [req-1b916054-1f5e-4f68-9342-771025c79b9a req-b8fddc41-bb84-4181-ac84-115457ef2720 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Refreshing instance network info cache due to event network-changed-6b9deb14-333c-4a73-a867-4ebf056c7ea2. {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 18:42:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1b916054-1f5e-4f68-9342-771025c79b9a req-b8fddc41-bb84-4181-ac84-115457ef2720 service nova] Acquiring lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:42:41 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1b916054-1f5e-4f68-9342-771025c79b9a req-b8fddc41-bb84-4181-ac84-115457ef2720 service nova] Acquired lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:42:41 user nova-compute[75342]: DEBUG nova.network.neutron [req-1b916054-1f5e-4f68-9342-771025c79b9a req-b8fddc41-bb84-4181-ac84-115457ef2720 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Refreshing network info cache for port 6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 18:42:42 user nova-compute[75342]: DEBUG nova.network.neutron [req-1b916054-1f5e-4f68-9342-771025c79b9a req-b8fddc41-bb84-4181-ac84-115457ef2720 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updated VIF entry in instance network info cache for port 6b9deb14-333c-4a73-a867-4ebf056c7ea2. {{(pid=75342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 18:42:42 user nova-compute[75342]: DEBUG nova.network.neutron [req-1b916054-1f5e-4f68-9342-771025c79b9a req-b8fddc41-bb84-4181-ac84-115457ef2720 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating instance_info_cache with network_info: [{"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:42:42 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-1b916054-1f5e-4f68-9342-771025c79b9a req-b8fddc41-bb84-4181-ac84-115457ef2720 service nova] Releasing lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:42:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:42:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:42:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:42:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:42:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG nova.objects.instance [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:42:45 user nova-compute[75342]: INFO nova.compute.manager [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attaching volume 9fbedff7-6c14-4e0b-86be-2accfb20f54c to /dev/vdb
Nov 16 18:42:45 user nova-compute[75342]: DEBUG os_brick.utils [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86a3d53-f83e-40cd-aa2c-4a6a724d06ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[443ce458-8ec5-451b-a0f8-8083c354d2e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[428aede9-abd3-4ec9-86fb-562f4cf65a83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[207540d7-b675-4352-8312-77c484dd31c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:42:45 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:42:45 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[328f289d-a2b0-449c-ada5-826386ec12e2]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG os_brick.utils [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:42:45 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating existing volume attachment record: ec12d7a0-8240-479e-89ba-d82dbc4b110e {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:42:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGzbLXmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:42:50 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:42:50 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:42:50 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a9686b-e4a3-4266-af67-b3161445331d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:42:50 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e8a9bd-5c94-4df4-a48c-e1285d7ea232]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c] added
Nov 16 18:42:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97cad09-d1d5-4fcc-9563-b9ef38cff142]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baf5e4c-15cd-44d4-9e01-de649149f035]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGzbLXmk {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGzbLXmk" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cfa11b-bd5a-4c10-b4aa-53a037d7a5fb]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pGzbLXmk'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdf74e1-6b70-43a6-bce4-60b4bba550cb]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[875a838c-1e54-4742-b61a-7815cfa151e8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:42:50 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:42:50 user nova-compute[75342]:  {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:42:50 user nova-compute[75342]: WARNING os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 18:42:50 user nova-compute[75342]: 
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cdce97-47b4-4439-b95b-6e92bbaf63de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c, portal: 172.16.0.220,3260]
Nov 16 18:42:50 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c, portal: 172.16.0.220,3260] successful.
Nov 16 18:42:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac737a2f-9c95-40e0-ab75-00cacf488172]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[678dae88-4954-492e-a76c-6633cd039ac3]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c (non-flash)
Nov 16 18:42:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c (non-flash)
Nov 16 18:42:50 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a589ba93-e192-4d03-849e-d8411311e630]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:42:50 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGzbLXmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:42:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:42:51 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23935663632323365', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:42:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935663632323365', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:42:51 user nova-compute[75342]: DEBUG nova.objects.instance [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:42:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:42:51 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:42:51 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:42:51 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:42:51 user nova-compute[75342]:   <serial>9fbedff7-6c14-4e0b-86be-2accfb20f54c</serial>
Nov 16 18:42:51 user nova-compute[75342]: </disk>
Nov 16 18:42:51 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:42:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:42:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:42:51 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No VIF found with MAC fa:16:3e:b8:f1:bf, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:42:52 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d58b270f-54a8-4ac6-9c30-619125487124 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.619s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:42:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:42:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:43:02 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:43:02 user nova-compute[75342]: INFO nova.compute.manager [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Detaching volume 9fbedff7-6c14-4e0b-86be-2accfb20f54c
Nov 16 18:43:02 user nova-compute[75342]: INFO nova.virt.block_device [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attempting to driver detach volume 9fbedff7-6c14-4e0b-86be-2accfb20f54c from mountpoint /dev/vdb
Nov 16 18:43:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Attempting to detach device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:43:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:43:02 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:43:02 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:43:02 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:43:02 user nova-compute[75342]:   <serial>9fbedff7-6c14-4e0b-86be-2accfb20f54c</serial>
Nov 16 18:43:02 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:43:02 user nova-compute[75342]: </disk>
Nov 16 18:43:02 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:43:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:02 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Successfully detached device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the persistent domain config.
Nov 16 18:43:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:43:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:43:02 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:43:02 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:43:02 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:43:02 user nova-compute[75342]:   <serial>9fbedff7-6c14-4e0b-86be-2accfb20f54c</serial>
Nov 16 18:43:02 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:43:02 user nova-compute[75342]: </disk>
Nov 16 18:43:02 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:43:03 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:43:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:09 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:43:10 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:43:12 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:43:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:43:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:43:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:43:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:43:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:43:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:13 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:43:13 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:43:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:43:15 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:43:16 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:43:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:43:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:43:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:43:16 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:43:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:43:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:43:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=9020MB free_disk=25.05870819091797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:43:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:43:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:43:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:43:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:43:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:43:17 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:43:17 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:43:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:43:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:43:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:20 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:43:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:43:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:43:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:43:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:43:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:43:20 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:43:20 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating instance_info_cache with network_info: [{"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:43:20 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:43:20 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:43:20 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:43:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:23 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 is timed out.
Nov 16 18:43:23 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Successfully detached device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the live domain config.
Nov 16 18:43:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGzbLXmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:43:23 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ac2498-98c5-45b4-ac97-e76d1c2f74e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:43:23 user nova-compute[75342]: No targets found.
Nov 16 18:43:23 user nova-compute[75342]: iSNS:
Nov 16 18:43:23 user nova-compute[75342]: No targets found.
Nov 16 18:43:23 user nova-compute[75342]: STATIC:
Nov 16 18:43:23 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c
Nov 16 18:43:23 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:43:23 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:43:23 user nova-compute[75342]: FIRMWARE:
Nov 16 18:43:23 user nova-compute[75342]: No targets found.
Nov 16 18:43:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:43:23 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:43:23 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14794f4-ae1d-4225-93f1-a477601fc2b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1133b2f-e95a-475f-b455-6c72473d3b86]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c (non-flash)
Nov 16 18:43:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c (non-flash)
Nov 16 18:43:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6c855a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a5570b-7d4c-4c27-9a17-2afe32114b3f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d0ee75-4f5a-439c-b62a-e6368d82d528]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8c3681-318b-44f6-a063-eff07ead0a9c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b860a80c-bee5-4bec-bda2-4e63d4cb5657]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[38020765-0a02-4461-bd14-2b7150bac608]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0e5bee-0720-470d-88b9-958fa6c0389c]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c, portal: 172.16.0.220,3260]
Nov 16 18:43:23 user nova-compute[75342]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c, portal: 172.16.0.220,3260] successful.
Nov 16 18:43:23 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fbedff7-6c14-4e0b-86be-2accfb20f54c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ba9c6a-5516-4a3b-82f2-ecc1e832b357]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== disconnect_volume: return (297ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:43:23 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:43:24 user nova-compute[75342]: DEBUG nova.objects.instance [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:43:24 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-be3a2cb0-9764-40d6-b169-75fd9aa3b6a3 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.605s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:43:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:43:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:43:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:43:54 user nova-compute[75342]: INFO nova.compute.manager [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attaching volume 79ce8e64-f727-49d6-8ff7-6147d435b7a2 to /dev/vdb
Nov 16 18:43:54 user nova-compute[75342]: DEBUG os_brick.utils [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d0034a-6450-449f-a444-a1a3a4167f52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58aa9e7-80af-4f30-8bd6-ad7ae1da21b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[972dacc7-4dc3-41e9-ba9e-303bd38578f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[233c74ea-9c97-4775-b6f2-36f483f36fc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:43:54 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:43:54 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24960a7-e594-41fe-9104-b4059466716d]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG os_brick.utils [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:43:54 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating existing volume attachment record: a1f07851-945c-44b0-b4fe-d1b0121911eb {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:43:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etbKiZUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:43:59 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:43:59 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:43:59 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac3543d-661b-4565-a19b-119669d8df91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:43:59 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[984d644b-d900-411f-8749-f16726554a67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2] added
Nov 16 18:43:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79e74ca-a244-49b9-84be-88585b846990]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebedf673-959a-4e62-8099-6bf8d344a751]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etbKiZUf {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etbKiZUf" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7d42d1-59d6-458f-b5af-2371b90f2025]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etbKiZUf'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42be76f-bd18-47ab-ba37-bff1f5bb68ac]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[316bcf65-a5e1-40de-ad2c-4319faecf98b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:43:59 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:43:59 user nova-compute[75342]:  {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:43:59 user nova-compute[75342]: WARNING os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 18:43:59 user nova-compute[75342]: 
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[530d3e4d-2c12-4029-a68e-07efc1e57346]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2, portal: 172.16.0.220,3260]
Nov 16 18:43:59 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2, portal: 172.16.0.220,3260] successful.
Nov 16 18:43:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[958ba064-9a12-45d3-9691-bc2756b9f347]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3306ae28-a7ca-487b-a0a2-51f0cc5c659b]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 (non-flash)
Nov 16 18:43:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 (non-flash)
Nov 16 18:43:59 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafea8fa-f2e2-4991-8ef4-52854b35fef0]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:43:59 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:44:00 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:44:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etbKiZUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:44:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:44:00 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23632323334333035', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:44:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632323334333035', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:44:00 user nova-compute[75342]: DEBUG nova.objects.instance [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:44:00 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:44:00 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:44:00 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:44:00 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:44:00 user nova-compute[75342]:   <serial>79ce8e64-f727-49d6-8ff7-6147d435b7a2</serial>
Nov 16 18:44:00 user nova-compute[75342]: </disk>
Nov 16 18:44:00 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:44:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:44:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:44:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No VIF found with MAC fa:16:3e:b8:f1:bf, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:44:01 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-1b271ccd-f539-4526-96d3-849db2e5f2b4 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.696s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:44:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:44:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:44:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:44:04 user nova-compute[75342]: INFO nova.compute.manager [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Detaching volume 79ce8e64-f727-49d6-8ff7-6147d435b7a2
Nov 16 18:44:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:44:04 user nova-compute[75342]: INFO nova.virt.block_device [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attempting to driver detach volume 79ce8e64-f727-49d6-8ff7-6147d435b7a2 from mountpoint /dev/vdb
Nov 16 18:44:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Attempting to detach device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:44:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:44:04 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:44:04 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:44:04 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:44:04 user nova-compute[75342]:   <serial>79ce8e64-f727-49d6-8ff7-6147d435b7a2</serial>
Nov 16 18:44:04 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:44:04 user nova-compute[75342]: </disk>
Nov 16 18:44:04 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:44:04 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Successfully detached device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the persistent domain config.
Nov 16 18:44:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:44:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:44:04 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:44:04 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:44:04 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:44:04 user nova-compute[75342]:   <serial>79ce8e64-f727-49d6-8ff7-6147d435b7a2</serial>
Nov 16 18:44:04 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:44:04 user nova-compute[75342]: </disk>
Nov 16 18:44:04 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:44:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:44:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:44:11 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:44:12 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:44:12 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:44:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:44:13 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:44:13 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:44:16 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:44:16 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:44:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:44:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:44:16 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:44:16 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:44:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:16 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:44:17 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:44:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=25.049945831298828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:44:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:44:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:44:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:44:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:44:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:44:17 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:44:17 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:44:17 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:44:17 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:44:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:44:18 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:44:21 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:44:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:44:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:44:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:44:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:44:21 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:44:21 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:44:21 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating instance_info_cache with network_info: [{"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:44:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:44:21 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:44:22 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:44:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:44:24 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 is timed out.
Nov 16 18:44:24 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Successfully detached device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the live domain config.
Nov 16 18:44:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etbKiZUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:44:24 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea95569-3914-4481-982e-f2a6643e4497]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:44:24 user nova-compute[75342]: No targets found.
Nov 16 18:44:24 user nova-compute[75342]: iSNS:
Nov 16 18:44:24 user nova-compute[75342]: No targets found.
Nov 16 18:44:24 user nova-compute[75342]: STATIC:
Nov 16 18:44:24 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2
Nov 16 18:44:24 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:44:24 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:44:24 user nova-compute[75342]: FIRMWARE:
Nov 16 18:44:24 user nova-compute[75342]: No targets found.
Nov 16 18:44:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:44:24 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:44:24 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fd7235-d51f-4c26-a1a8-48325256270e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aac1344-90ef-4f4b-91df-482055b5ff01]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 (non-flash)
Nov 16 18:44:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 (non-flash)
Nov 16 18:44:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a447f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2314b2fc-34c5-4097-8798-02414aad5954]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e42b4a-679f-4c1a-b60c-872c87d5863b]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c497b0b7-f1b2-45b0-a5e7-2020a768a128]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2656c3cc-2297-4ac1-96a6-1491a1c0473c]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc47fc5-5953-4fda-9a58-d0810d954eb7]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ff40a4-8599-4baf-9f54-f6cb8480f5fe]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2, portal: 172.16.0.220,3260]
Nov 16 18:44:24 user nova-compute[75342]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2, portal: 172.16.0.220,3260] successful.
Nov 16 18:44:24 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ce8e64-f727-49d6-8ff7-6147d435b7a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1bafb0-5ff6-4290-aa22-5bd29d574cca]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== disconnect_volume: return (277ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:44:24 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:44:25 user nova-compute[75342]: DEBUG nova.objects.instance [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:44:25 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-3a473d5e-1f0f-457d-9004-36779b396d7f tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.575s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:44:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:44:32 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:44:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:44:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:44:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:44:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:44:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG nova.objects.instance [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:44:56 user nova-compute[75342]: INFO nova.compute.manager [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attaching volume 5dd1c019-503b-4926-9173-b926b0742d1a to /dev/vdb
Nov 16 18:44:56 user nova-compute[75342]: DEBUG os_brick.utils [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[800c1ea8-29c7-49db-b8e6-cc34d78364c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8dd322-212d-4cd9-a840-6023521ea1df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a36159-7464-4642-8260-60e0fad97278]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8e80d4-0bb1-4fed-b541-f132640741ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:44:56 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:44:56 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2732ab1-3012-4f50-b062-2b5a4563ab23]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG os_brick.utils [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:44:56 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating existing volume attachment record: 50f6cb73-0fb7-4339-8fdf-c72ab00c2647 {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:44:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:44:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYEdhlMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:45:01 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:45:01 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:45:01 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b877401c-4dd2-4282-b6b3-4362e426a888]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:45:01 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05c73e4-fa81-4d69-aedc-310afbc937d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a] added
Nov 16 18:45:01 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ee0f60-86ad-4084-8e26-a743c13aae3a]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d724d9e-315d-4d6c-8665-66e4232fb26c]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYEdhlMo {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYEdhlMo" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[750cc600-eb91-470c-ace8-b2a9d556d8f7]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eYEdhlMo'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a768d9ee-37df-4ffd-b3f6-0ed63b6bc0ce]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d7608f-96f1-47dd-8e36-a327a2f5b5f1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:45:01 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:45:01 user nova-compute[75342]:  {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:45:01 user nova-compute[75342]: WARNING os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 18:45:01 user nova-compute[75342]: 
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[602da271-38d2-4a8d-9984-83d867c46c62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a, portal: 172.16.0.220,3260]
Nov 16 18:45:01 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a, portal: 172.16.0.220,3260] successful.
Nov 16 18:45:01 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b1f10b-42d2-4a2a-981b-34aa37273bea]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fd9293-deb4-4b2b-9d21-3552b1bc86c9]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a (non-flash)
Nov 16 18:45:01 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a (non-flash)
Nov 16 18:45:01 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5dbda6-861d-4d50-aec1-158402cac8c0]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:45:01 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYEdhlMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:45:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:45:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26635323939393636', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:45:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635323939393636', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:45:02 user nova-compute[75342]: DEBUG nova.objects.instance [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:45:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:45:02 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:45:02 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:45:02 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:45:02 user nova-compute[75342]:   <serial>5dd1c019-503b-4926-9173-b926b0742d1a</serial>
Nov 16 18:45:02 user nova-compute[75342]: </disk>
Nov 16 18:45:02 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:45:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:45:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:45:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No VIF found with MAC fa:16:3e:b8:f1:bf, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:45:03 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-d5672879-aa87-41a7-8911-d754329dccfb tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.789s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:45:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:45:05 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:45:05 user nova-compute[75342]: INFO nova.compute.manager [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Detaching volume 5dd1c019-503b-4926-9173-b926b0742d1a
Nov 16 18:45:05 user nova-compute[75342]: INFO nova.virt.block_device [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attempting to driver detach volume 5dd1c019-503b-4926-9173-b926b0742d1a from mountpoint /dev/vdb
Nov 16 18:45:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Attempting to detach device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:45:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:45:05 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:45:05 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:45:05 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:45:05 user nova-compute[75342]:   <serial>5dd1c019-503b-4926-9173-b926b0742d1a</serial>
Nov 16 18:45:05 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:45:05 user nova-compute[75342]: </disk>
Nov 16 18:45:05 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:45:05 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Successfully detached device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the persistent domain config.
Nov 16 18:45:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:45:05 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:45:05 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:45:05 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:45:05 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:45:05 user nova-compute[75342]:   <serial>5dd1c019-503b-4926-9173-b926b0742d1a</serial>
Nov 16 18:45:05 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:45:05 user nova-compute[75342]: </disk>
Nov 16 18:45:05 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:45:06 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:45:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:12 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:45:12 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:45:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:13 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:45:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:45:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:45:16 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:45:17 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:45:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:18 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:45:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:45:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:45:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:45:18 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:45:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:19 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:45:19 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:45:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=25.048927307128906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:45:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:45:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:45:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:45:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:45:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:45:19 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:45:19 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:45:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:45:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating instance_info_cache with network_info: [{"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:45:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:23 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:45:26 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 is timed out.
Nov 16 18:45:26 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Successfully detached device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the live domain config.
Nov 16 18:45:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYEdhlMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:45:26 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10b12f8-6bfb-455f-830d-850e7229503a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:45:26 user nova-compute[75342]: No targets found.
Nov 16 18:45:26 user nova-compute[75342]: iSNS:
Nov 16 18:45:26 user nova-compute[75342]: No targets found.
Nov 16 18:45:26 user nova-compute[75342]: STATIC:
Nov 16 18:45:26 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a
Nov 16 18:45:26 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:45:26 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:45:26 user nova-compute[75342]: FIRMWARE:
Nov 16 18:45:26 user nova-compute[75342]: No targets found.
Nov 16 18:45:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:45:26 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:45:26 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9737c80b-adf7-4752-9217-875a88bdeffe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea32ad2-4394-43ff-9ce3-46134ef22357]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a (non-flash)
Nov 16 18:45:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a (non-flash)
Nov 16 18:45:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a466d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd65f91-4c92-4a44-b71a-f15fdedae035]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e462dbce-164a-4e5f-93a7-0196427570ba]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f105512a-4a69-4a8b-91c3-a9860b82fc42]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c766ce7-0507-4a0f-baea-cf1441dd7c34]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9007d6da-c6db-4110-afbb-51c259e68b1f]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfdc4b8-8338-49c2-8796-3d14ef2f1cd8]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a, portal: 172.16.0.220,3260]
Nov 16 18:45:26 user nova-compute[75342]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a, portal: 172.16.0.220,3260] successful.
Nov 16 18:45:26 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dd1c019-503b-4926-9173-b926b0742d1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[04228736-3bc3-4f1d-b9a5-860d54d886f6]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== disconnect_volume: return (280ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:45:26 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:45:27 user nova-compute[75342]: DEBUG nova.objects.instance [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:45:27 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-deab914f-952a-4bdf-a631-d687af8c4308 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.637s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:45:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:45:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:45:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:45:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:45:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:45:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:45:57 user nova-compute[75342]: DEBUG nova.objects.instance [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:45:57 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:45:58 user nova-compute[75342]: INFO nova.compute.manager [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attaching volume 15e336c4-bb40-4dc4-bd36-98fe2e591aa0 to /dev/vdb
Nov 16 18:45:58 user nova-compute[75342]: DEBUG os_brick.utils [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b043fe4a-84fc-461e-9617-5e5755a4f835]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa8666241d99\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[586c56ca-ea83-4458-9383-c71845307876]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7060763-46af-4de0-80c8-cb6a2b17017a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b83027b-21b6-480b-991d-3ceb506d78e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Running cmd (subprocess): nvme version {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] 'nvme version' failed. Not Retrying. {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] nvme not present on system {{(pid=75342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 18:45:58 user nova-compute[75342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 18:45:58 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca072b5c-7e65-40dc-b5d9-0720a8fd6865]: (4, '') {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.lightos [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] LIGHTOS: no hostnqn found. {{(pid=75342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG os_brick.utils [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa8666241d99', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:45:58 user nova-compute[75342]: DEBUG nova.virt.block_device [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating existing volume attachment record: fd86f0e6-f6ff-416d-8b38-462592e758cc {{(pid=75342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 18:45:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Calling os-brick to attach iSCSI Volume {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSnPOAfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:46:02 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:46:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:46:02 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:46:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:46:02 user nova-compute[75342]: INFO os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0674e7e-9709-4f40-b63b-05e2750a1761]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 18:46:02 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a46904-f47e-44d5-8e22-926990b5e45f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0] added\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0] added
Nov 16 18:46:02 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4972bfd-b8ec-4805-9c43-a9479cbf5607]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a1514a-0e9a-4be4-b428-ccc46b5270f6]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:46:02 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lSnPOAfE {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lSnPOAfE" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d65863c-5cff-4172-ba11-b9e08ef7ed74]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lSnPOAfE'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e660987-9649-4900-baa3-a311701bf74d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7435d237-2cba-48c4-9154-f4205ecf06d0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:46:03 user nova-compute[75342]:  {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 18:46:03 user nova-compute[75342]:  {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:46:03 user nova-compute[75342]: WARNING os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 18:46:03 user nova-compute[75342]: 
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --login {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e31ab9-b66c-412d-b9f5-9aadf4ef3fda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0, portal: 172.16.0.220,3260]
Nov 16 18:46:03 user nova-compute[75342]: Login to [iface: default, target: iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0, portal: 172.16.0.220,3260] successful.
Nov 16 18:46:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a585926-c645-49f5-99fa-4d8bf7beb06d]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[85df814c-ab37-4cdf-9529-652ea0d70aa0]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 (non-flash)
Nov 16 18:46:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 (non-flash)
Nov 16 18:46:03 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Connected to 172.16.0.220:3260 {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d396422-664e-45d7-94b8-1473c170bdb8]: (4, ('- - 0', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:03 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSnPOAfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '26134386361336363', 'path': '/dev/sdb'} {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134386361336363', 'path': '/dev/sdb'} {{(pid=75342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG nova.objects.instance [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 18:46:04 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:46:04 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:46:04 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:46:04 user nova-compute[75342]:   <serial>15e336c4-bb40-4dc4-bd36-98fe2e591aa0</serial>
Nov 16 18:46:04 user nova-compute[75342]: </disk>
Nov 16 18:46:04 user nova-compute[75342]:  {{(pid=75342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No BDM found with device name vda, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] No VIF found with MAC fa:16:3e:b8:f1:bf, not building metadata {{(pid=75342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 18:46:04 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-7a9b1e84-fc66-49f5-a99b-9589e5bb8724 tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.723s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:46:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:46:07 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:46:07 user nova-compute[75342]: INFO nova.compute.manager [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Detaching volume 15e336c4-bb40-4dc4-bd36-98fe2e591aa0
Nov 16 18:46:07 user nova-compute[75342]: INFO nova.virt.block_device [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Attempting to driver detach volume 15e336c4-bb40-4dc4-bd36-98fe2e591aa0 from mountpoint /dev/vdb
Nov 16 18:46:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Attempting to detach device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the persistent domain config. {{(pid=75342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 18:46:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:46:07 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:46:07 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:46:07 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:46:07 user nova-compute[75342]:   <serial>15e336c4-bb40-4dc4-bd36-98fe2e591aa0</serial>
Nov 16 18:46:07 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:46:07 user nova-compute[75342]: </disk>
Nov 16 18:46:07 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:46:07 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Successfully detached device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the persistent domain config.
Nov 16 18:46:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the live domain config. {{(pid=75342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 18:46:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.guest [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 18:46:07 user nova-compute[75342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 18:46:07 user nova-compute[75342]:   <source dev="/dev/sdb"/>
Nov 16 18:46:07 user nova-compute[75342]:   <target dev="vdb" bus="virtio"/>
Nov 16 18:46:07 user nova-compute[75342]:   <serial>15e336c4-bb40-4dc4-bd36-98fe2e591aa0</serial>
Nov 16 18:46:07 user nova-compute[75342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 18:46:07 user nova-compute[75342]: </disk>
Nov 16 18:46:07 user nova-compute[75342]:  {{(pid=75342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 18:46:07 user nova-compute[75342]: DEBUG nova.virt.libvirt.driver [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 18:46:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:13 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:14 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:46:15 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:16 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 18:46:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] There are 0 instances to clean {{(pid=75342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 18:46:17 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:17 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:18 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:46:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:46:18 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:46:18 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:46:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:18 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:19 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:46:19 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=25.04800033569336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing inventories for resource provider fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating ProviderTree inventory for provider fdd6b940-75a0-4315-8416-79157aaeea59 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Updating inventory in ProviderTree for provider fdd6b940-75a0-4315-8416-79157aaeea59 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing aggregate associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, aggregates: None {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Refreshing trait associations for resource provider fdd6b940-75a0-4315-8416-79157aaeea59, traits: COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:46:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:46:20 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:22 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquired lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Forcefully refreshing network info cache for instance {{(pid=75342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG nova.objects.instance [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lazy-loading 'info_cache' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG nova.network.neutron [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating instance_info_cache with network_info: [{"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Releasing lock "refresh_cache-631dbfac-d5f2-438d-94e0-c8980f6a13b9" {{(pid=75342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updated the network info_cache for instance {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:23 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 18:46:27 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 is timed out.
Nov 16 18:46:27 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Successfully detached device vdb from instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9 from the live domain config.
Nov 16 18:46:27 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] calling os-brick to detach iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6c84051b0>, {'target_iqn': 'iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSnPOAfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 18:46:27 user nova-compute[75342]: WARNING os_brick.initiator.connectors.base [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 18:46:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80fdb89-4b7f-4834-b846-41aed50c7077]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 18:46:27 user nova-compute[75342]: No targets found.
Nov 16 18:46:27 user nova-compute[75342]: iSNS:
Nov 16 18:46:27 user nova-compute[75342]: No targets found.
Nov 16 18:46:27 user nova-compute[75342]: STATIC:
Nov 16 18:46:27 user nova-compute[75342]: Target: iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0
Nov 16 18:46:27 user nova-compute[75342]:         Portal: 172.16.0.220:3260,-1
Nov 16 18:46:27 user nova-compute[75342]:                 Iface Name: default
Nov 16 18:46:27 user nova-compute[75342]: FIRMWARE:
Nov 16 18:46:27 user nova-compute[75342]: No targets found.
Nov 16 18:46:27 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 18:46:27 user nova-compute[75342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 18:46:27 user nova-compute[75342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0', 0)] {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b218b4e-de9b-4bbb-9ff3-967b8f7336f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa0149c-dab4-4a49-b943-80917f1cbdb3]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 (non-flash)\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 (non-flash)
Nov 16 18:46:27 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 (non-flash)
Nov 16 18:46:27 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6a43fc700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0'): ({'sdb'}, set())}) {{(pid=75342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Removing single pathed devices sdb {{(pid=75342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 18:46:27 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.118s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[690399a0-0368-4f9a-896c-0fe9b1f38033]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeb8dc5-6c6f-4c43-9a11-ac968a0d9195]: (4, ('ok\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Flushing IO for device /dev/sdb {{(pid=75342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede6e587-25be-4492-b031-a5330087bfc9]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[538fcf94-9b6e-4424-ad3a-04c5c423b4ac]: (4, ('1', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG os_brick.initiator.linuxscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] SCSI volumes sdb have been removed. {{(pid=75342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0')] {{(pid=75342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab3eec3-4fcc-4006-a4de-bf83d5791551]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --logout {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2fccbc-8198-481b-b927-82e59b52893c]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0, portal: 172.16.0.220,3260]
Nov 16 18:46:28 user nova-compute[75342]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0, portal: 172.16.0.220,3260] successful.
Nov 16 18:46:28 user nova-compute[75342]:  stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op delete {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e336c4-bb40-4dc4-bd36-98fe2e591aa0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85570) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f12bc07-9429-46d2-adf7-b810a1adc3f7]: (4, ('', '')) {{(pid=85570) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.base [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] <== disconnect_volume: return (371ms) None {{(pid=75342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Disconnected iSCSI Volume {{(pid=75342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG nova.objects.instance [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'flavor' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:46:28 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-bedc50b8-efa9-4ab6-b197-eadf19e1c4ab tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.648s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:46:32 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:36 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:37 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:46:38 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:46:38 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Triggering sync for uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 18:46:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:46:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:46:38 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:46:42 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:47 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:46:52 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:46:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:46:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 18:46:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:46:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 18:46:57 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:02 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:12 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:47:13 user nova-compute[75342]: INFO nova.compute.manager [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Terminating instance
Nov 16 18:47:13 user nova-compute[75342]: DEBUG nova.compute.manager [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Start destroying the instance on the hypervisor. {{(pid=75342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-03e14bb3-27a2-4a9e-955a-ec59e94b6160 req-c90ea83d-49ca-4dac-82d7-ba9bbbb48b7c service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Received event network-vif-unplugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-03e14bb3-27a2-4a9e-955a-ec59e94b6160 req-c90ea83d-49ca-4dac-82d7-ba9bbbb48b7c service nova] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-03e14bb3-27a2-4a9e-955a-ec59e94b6160 req-c90ea83d-49ca-4dac-82d7-ba9bbbb48b7c service nova] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-03e14bb3-27a2-4a9e-955a-ec59e94b6160 req-c90ea83d-49ca-4dac-82d7-ba9bbbb48b7c service nova] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-03e14bb3-27a2-4a9e-955a-ec59e94b6160 req-c90ea83d-49ca-4dac-82d7-ba9bbbb48b7c service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] No waiting events found dispatching network-vif-unplugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:47:13 user nova-compute[75342]: DEBUG nova.compute.manager [req-03e14bb3-27a2-4a9e-955a-ec59e94b6160 req-c90ea83d-49ca-4dac-82d7-ba9bbbb48b7c service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Received event network-vif-unplugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 for instance with task_state deleting. {{(pid=75342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:14 user nova-compute[75342]: INFO nova.virt.libvirt.driver [-] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Instance destroyed successfully.
Nov 16 18:47:14 user nova-compute[75342]: DEBUG nova.objects.instance [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lazy-loading 'resources' on Instance uuid 631dbfac-d5f2-438d-94e0-c8980f6a13b9 {{(pid=75342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG nova.virt.libvirt.vif [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T18:40:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2025334440',display_name='tempest-SnapshotDataIntegrityTests-server-2025334440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2025334440',id=53,image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLRMr7QYpzuNgG+9cbP0qAol9o2upv4uj52vjCWq8dtzwkfphF06f02iGfONqbXj8wuVlTkiZ71Eupcn69I+y4lSplDkiekvPe/NpU0A9Wgr08BjohO29BUGLKv/8ZI8g==',key_name='tempest-keypair-273943359',keypairs=<?>,launch_index=0,launched_at=2023-11-16T18:40:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08a6c66fde6c404eb8e651a1fab2a3c8',ramdisk_id='',reservation_id='r-bi3vwbgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c3510820-8b2c-4ce9-a892-c10a662aeed6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1869800382',owner_user_name='tempest-SnapshotDataIntegrityTests-1869800382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T18:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10ec34ffcd99495cbc04a745341d9b23',uuid=631dbfac-d5f2-438d-94e0-c8980f6a13b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Converting VIF {"id": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "address": "fa:16:3e:b8:f1:bf", "network": {"id": "61ed1770-dcc5-46d0-87fa-37a7ab859b1d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-885956247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08a6c66fde6c404eb8e651a1fab2a3c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b9deb14-33", "ovs_interfaceid": "6b9deb14-333c-4a73-a867-4ebf056c7ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG nova.network.os_vif_util [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:f1:bf,bridge_name='br-int',has_traffic_filtering=True,id=6b9deb14-333c-4a73-a867-4ebf056c7ea2,network=Network(61ed1770-dcc5-46d0-87fa-37a7ab859b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9deb14-33') {{(pid=75342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG os_vif [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:f1:bf,bridge_name='br-int',has_traffic_filtering=True,id=6b9deb14-333c-4a73-a867-4ebf056c7ea2,network=Network(61ed1770-dcc5-46d0-87fa-37a7ab859b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9deb14-33') {{(pid=75342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b9deb14-33, bridge=br-int, if_exists=True) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=852ec7fe-67c9-46ee-831f-05ba67904a72) {{(pid=75342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:47:14 user nova-compute[75342]: INFO os_vif [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:f1:bf,bridge_name='br-int',has_traffic_filtering=True,id=6b9deb14-333c-4a73-a867-4ebf056c7ea2,network=Network(61ed1770-dcc5-46d0-87fa-37a7ab859b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b9deb14-33')
Nov 16 18:47:14 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Deleting instance files /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9_del
Nov 16 18:47:14 user nova-compute[75342]: INFO nova.virt.libvirt.driver [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Deletion of /opt/stack/data/nova/instances/631dbfac-d5f2-438d-94e0-c8980f6a13b9_del complete
Nov 16 18:47:14 user nova-compute[75342]: INFO nova.compute.manager [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 18:47:14 user nova-compute[75342]: DEBUG oslo.service.loopingcall [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG nova.compute.manager [-] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Deallocating network for instance {{(pid=75342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] deallocate_for_instance() {{(pid=75342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 18:47:14 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG nova.network.neutron [-] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Updating instance_info_cache with network_info: [] {{(pid=75342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 18:47:15 user nova-compute[75342]: INFO nova.compute.manager [-] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Took 0.94 seconds to deallocate network for instance.
Nov 16 18:47:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:47:15 user nova-compute[75342]: INFO nova.scheduler.client.report [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Deleted allocations for instance 631dbfac-d5f2-438d-94e0-c8980f6a13b9
Nov 16 18:47:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-c856bd81-3550-425b-b3a7-07004313aedf tempest-SnapshotDataIntegrityTests-1869800382 tempest-SnapshotDataIntegrityTests-1869800382-project-member] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.211s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-f850156b-dcf3-48b7-9763-caa2be149cfa req-21eb8c60-bc11-47fe-9959-2906b1a5c792 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Received event network-vif-plugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f850156b-dcf3-48b7-9763-caa2be149cfa req-21eb8c60-bc11-47fe-9959-2906b1a5c792 service nova] Acquiring lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f850156b-dcf3-48b7-9763-caa2be149cfa req-21eb8c60-bc11-47fe-9959-2906b1a5c792 service nova] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [req-f850156b-dcf3-48b7-9763-caa2be149cfa req-21eb8c60-bc11-47fe-9959-2906b1a5c792 service nova] Lock "631dbfac-d5f2-438d-94e0-c8980f6a13b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:47:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-f850156b-dcf3-48b7-9763-caa2be149cfa req-21eb8c60-bc11-47fe-9959-2906b1a5c792 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] No waiting events found dispatching network-vif-plugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 18:47:15 user nova-compute[75342]: WARNING nova.compute.manager [req-f850156b-dcf3-48b7-9763-caa2be149cfa req-21eb8c60-bc11-47fe-9959-2906b1a5c792 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Received unexpected event network-vif-plugged-6b9deb14-333c-4a73-a867-4ebf056c7ea2 for instance with vm_state deleted and task_state None.
Nov 16 18:47:15 user nova-compute[75342]: DEBUG nova.compute.manager [req-f850156b-dcf3-48b7-9763-caa2be149cfa req-21eb8c60-bc11-47fe-9959-2906b1a5c792 service nova] [instance: 631dbfac-d5f2-438d-94e0-c8980f6a13b9] Received event network-vif-deleted-6b9deb14-333c-4a73-a867-4ebf056c7ea2 {{(pid=75342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 18:47:17 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:47:19 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:47:19 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:47:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=9147MB free_disk=25.075119018554688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:47:19 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:47:21 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:47:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:47:24 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:47:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:47:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:47:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 18:47:24 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:47:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:34 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:39 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:47:44 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:49 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:54 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:47:59 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:48:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:48:04 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:48:07 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:48:09 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:48:10 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:48:14 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:48:15 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:48:16 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:48:16 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:48:16 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 18:48:17 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:48:18 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:48:19 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 18:48:21 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:48:21 user nova-compute[75342]: WARNING nova.virt.libvirt.driver [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 18:48:21 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Hypervisor/Node resource view: name=user free_ram=9270MB free_disk=25.07402801513672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG nova.compute.provider_tree [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed in ProviderTree for provider: fdd6b940-75a0-4315-8416-79157aaeea59 {{(pid=75342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG nova.scheduler.client.report [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Inventory has not changed for provider fdd6b940-75a0-4315-8416-79157aaeea59 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG nova.compute.resource_tracker [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Compute_service record updated for user:user {{(pid=75342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 18:48:21 user nova-compute[75342]: DEBUG oslo_concurrency.lockutils [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=75342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 18:48:23 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:48:24 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 18:48:24 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:48:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Starting heal instance info cache {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 18:48:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Rebuilding the list of instances to heal {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 18:48:24 user nova-compute[75342]: DEBUG nova.compute.manager [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Didn't find any instances for network info cache update. {{(pid=75342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 18:48:26 user nova-compute[75342]: DEBUG oslo_service.periodic_task [None req-58694f97-3ada-4e87-9d90-c5413bfb79e9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 18:48:29 user nova-compute[75342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}